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ABSTRACT 



This booklet surveys all the research studies 
(approx. 205), undertaken at ETS from duly 1968 through June 1969. It 
offers research results to interested, nonresearch professional 
readers, and supplements more formal reports for professionals 
interested in research processes as well. Four major themes in the 
ETS research program are emphasized: (1) the assessing of human 

beings as individuals, rather than as ''averages" ; (2) assessing 

educational processes in terms of systems, rather than concentrating 
solely on separate processes; (3) a concentration upon research aimed 
at gaining an understanding of how children learn during their 
earliest years; and (4) initiating and carrying out research in a 
real world with all its complexities. The contents are grouped into 
four categories: Psychological Research; Educational Applications; 
Theories, Methods, and Systems Research; and Publications and 
Speeches of ETS Staff members. (CK) 
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PREFACE 



Educational research is a fascinating field because its aim is. quite direct- 
ly, to discover how to enhance the quality of man’s life. 

Through educational research, for example, we may discover how to 
preserve the fresh curiosity and delight in learning of the young child. 
We may learn what threatens this gift, and how to remove the threat. 
We may also discover how we may more surely rekindle minds of all 
ages that have been turned off by life and circumstance, how to lessen 
hatred and hostility, and to increase love and respect — for others, and 
for ourselves. These are root concerns of current educational research, 
including that conducted by Educational Testing Service. 

To translate goals into action, over the past two decades ets has built 
a substantial base for research. During 1969-70 over 80 full-time re- 
search specialists (including 50 Ph.D.’s and 28 m.a.’s), with an addi- 
tional professional support staff of 55, were concerned with over 200 
ongoing projects. These ■ projects involved basic research in testing 
and measurement theory, individual personality and social behavior, 
human learning and cognition, and studies of how individual growth 
occurs under a wide range of influences. Research projects also attacked 
specific, sizable educational problems. Directions of continuing import- 
ance, for example, are research to aid disadvantaged peoples, to improve 
the conditions for early learning in homes and schools, to broaden and 
improve higher education, and to put the power of the computer at 
education’s service. 

Most of the research program is carried out within the ets facilities 
near Princeton, New Jersey. The main Research Center has 80 offices for 
research psychologists. It also houses computer facilities, experimental 
laboratories, workshops for constructing experimental devices, and an 
experimental classroom for preschool youngsters whose growth in 
learning is observed by ets child study specialists. Nearby is a specialized 
library with 15,000 volumes and 600 professional journals, which are 
mainly used by resident research workers but are available broadly to 
scholars in the field. 

This setting for research is unusual in social science. In effect, it grew 
out of a decision made at the time of the founding of ets as a nonprofit 
testing organization in 1948. The decision was to carry on research that 
might benefit education, and to fund the effort by investing in it one-half 
of ets’s revenue above costs. Thus, as school populations and the use of 
educational tests rose during the fifties and sixties, new funds became 
available to educational research. 

These funds were used to bring together a core research group that 
made contributions to measurement theory and educational research 
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from the late forties to the early 1960s. In 1965, with the aid of a grant 
from the National Science Foundation, etS built the new Research 
Center, and, aided by another sizable long-term grant from the U. S. 
Public Health Service, it was able to expand its staff and its objectives in 
basic psychological studies. 

Thus, with ets’s own funds serving as the financial base, and grants 
from federal agencies, foundations, and other sources underwriting 
many specific projects, a productive research organization has been 
established over the years. The investment of time, money, and aspira- 
tion over two decades have also made of this Center an unusually stable 
setting for research — a crucial point, since good research requires sus- 
tained effort, and sustained effort (as anyone doing research knows) 
requires considerable stability of circumstance. 

We trust the studies described in this publication will provide the 
reader with a convenient sampling of the effort that has been made to 
focus attention on the individual and his development. 

William W. Turnbull 

PRESIDENT 
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INTRODUCTION 



Over the past decade there has been rapid and exciting growth of educa- 
tional research, and ets research has been a significant part of that 
growth. This booklet attempts to describe its nature, plans, and potential 
benefits. It is a survey of all the research studies undertaken at ets during 
one recent year, specifically all studies that were ongoing at any point 
from July of 1968 through June of 1969. Some 205 studies are reported 
here. They have been written and categorized primarily to convey 
information easily to a nonresearch professional readership interested 
in research results. However, they have also been written to supplement 
more formal reports in conveying information quickly to a professional 
readership interested in research processes as well as findings. At the 
end of each summary the reader will find either an ets research bulletin 
number or a journal listing, whenever such complete information on a 
study is available. 

Our intention in this introduction is to provide an orientation to this 
very large body of work by calling attention to some of its underlying 
purposes. In particular, four major themes in the ETS research program 
will be emphasized, and we shall attempt to relate a few exemplary 
studies to these themes in presenting them. The four themes are these: 
(1) the assessing of human beings as individuals, rather than as "aver- 
ages”; (2) assessing educational processes in terms of systems^ rather 
than concentrating solely on separate processes; (3) a concentration 
upon research aimed at gaining an understanding of how children learn 
during their earliest years: and (4) initiating and carrying out research 
in a real world with all its complexities. 



Assessing Individuals Rather Than "Averages 99 

Traditional questions in education and psychology have frequently 
spawned answers that are either downright wrong, in that they sum- 
marize findings "on the average” in situations where a hypothetical "aver- 
age person” simply doesn’t exist, or else are seriously lacking in gen- 
erality, in that they fail to take account of the multiplicity of human 
differences and their interactions with environmental circumstances. 
An example is the "horse race” question typical of much educational 
research of past decades; Is textbook A better than textbook B? Is teacher 
A better than teacher B? Or, more generally, is treatment A better than 
treatment B? Such questions are usually resolved by comparing average 
gains in achievement for students receiving treatment A with average 
gains for students receiving treatment B. But suppose treatment A is 
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better for certain kinds of students and treatment B better for other 
kinds of students? A completely different evaluation of the treatments 
might result if some other, more complicated questions had been asked, 
such as "Do these treatments interact with differences in personality 
and cognitive characteristics of students — or with differences in their 
educational history, or family background, or community, or culture — 
to produce differential effects upon achievement?” 

This more complex type of question has been chiefly — though by no 
means exclusively — explored through studies that the reader will find 
grouped in this report under the categories of personality .computer studies, 
and to some extent methodological research and cultural diversity and the 
disadvantaged . In personality, work on cognitive styles has been partic- 
ularly extensive at ets. These are dimensions of individual differences 
in the performance of cognitive tasks that seem to reflect consistencies in 
the manner or form of cognition, as distinct from the content of cogni- 
tion or the level of skills displayed in cognitive performance. A character- 
istic study reported in this booklet is that of Fred Damarin on leveling vs. 
sharpening as a cognitive style. Other studies reported here explore 
cognitive styles with such self-descriptive titles as scanning, breadth of 
categorizing, cognitive complexity vs. simplicity, reflectiveness vs. 
impulsivity, and tolerance for incongruity. 

A promising adjunct to this type of interest is work in computer 
studies, such as Anastasio’s exploration of adaptive programming, Linn 
and Rock’s study of computer-assisted testing, and Lord’s study of 
tailored testing theory. The long-range aim of such studies is to put the 
computer to use not merely as a great batch-processor of scores and 
other data, but also as an interactive aid to students, teachers, and 
guidance personnel as a means of selectively tailoring testing as well as 
instruction to the individual. Particularly noteworthy in this connection 
are Novick’s study of Bayesian guidance technology and Katz’s study of 
the feasibility of developing a system of interactive guidance and in- 
formation for use in junior colleges. 

Assessing Education in Terms of Systems 
Rather Than Disparate Parts 

In any consideration of the individual, one soon encounters the question 
of environmental influence. But something more than individual and 
environment is involved — the interaction of the two is critical. To deal 
empirically with this complex phenomenon of interaction, it has become 
mandatory to view human development, and hence education as well, 
in systems terms. 

In this approach, personal characteristics and concerns are viewed in 
relation to social and environmental characteristics, and both are 
systematically combined with concerns about the effects of educational 
treatments. In this way a useful conceptual framework for educational 
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and psychological research may be developed that will help answer 
questions of how all the components interact and flow toward certain 
outcomes. Arising naturally from such a view, but more complicated 
than the "horse race” comparisons mentioned earlier, are such questions 
as "What dimensions of educational experience are associated with 
growth on dimensions of cognitive functioning, or with changes in 
attitude or affective involvement, and what social and environmental 
factors moderate these effects?” The need for such a multivariate inter- 
actional approach derives from the fact that we are dealing in education 
and psychology with a complicated system composed of many differenti- 
ated and overlapping subsystems, so that even in research on presumably 
circumscribed issues it is important to recognize the interrelatedness of 
personal, social, environmental, and educational factors. 

Undoubtedly the largest example of educational system assessment 
with which ets was involved during the time of this report was the 
National Assessment of Educational Progress. This is a project that 
seeks to establish for education an annual measure of national, system- 
wide progress comparable to the Gross National Product index for 
economic progress. Along with several other organizations, ets is in- 
volved in various phases of the enterprise, including the specification of 
objectives, the construction of exercises, and the conduct of field trials. 

Dyer’s method of measuring school system performance and Trismen’s 
educational systems information program are other notable examples, in 
the evaluation of educational systems section, of attempts to apply system- 
analytic techniques to education — in one case, the development of 
educational performance indicators for the New York State school sys- 
tem, and in the other the development of a computerized educational 
monitoring system generalized to fit the evaluation needs of a variety of 
school districts. 

However, multiple influences upon behavior should not only be consid- 
ered at the grand level of systems analysis, but at much simpler levels 
as well — such as in developing and evaluating a measure of academic 
achievement — where we sometimes forget that even specific responses 
are frequently complexly determined and buffeted by a host of environ- 
mental influences. Work with such measures as the Sequential Tests of 
Educational Progress (step) and School and College Ability Tests (scat) 
within the context of the ets Growth Study (see secondary education) is 
an example of this kind of emphasis. 




Research on Early Learning 

By the end of the time span for this report — that is, by June of 1969 — 
ets’s involvement in research in early learning was fully a third of its 
total research effort, most of it supported by grants from foundations 
and government agencies. The need to take a systematic look at present 
preschool programs and to develop useful alternatives for this and later 
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age levels is widely recognized. However, not so well known is the related 
need for a systematic development of instruments for assessing the 
cognitive/intellectual and the personal/social dimensions involved in 
present or prospective programs. Without such measures, meaningful 
evaluative studies of experimental programs in early education are 
difficult, if not impossible, to carry through. 

In the mid 1960s, ETS helped pioneer in this particular area of need 
with the new "Let’s Look at Children” measures, based largely on the 
theory of Jean Piaget, that were developed for first graders in the New 
York City school system. Subsequently, the Carnegie Corporation has 
funded a project to adapt to preschool age needs this approach that 
"teaches the teacher” while carrying out combined assessment and in- 
structional tasks with the children. A report of this research by Chitten- 
den and others is found in the early and primary education section. 

The greatest range of early childhood measures, however, is being 
used in the Longitudinal Study of Disadvantaged Children and Their 
First School Experiences (see cultural diversity and the disadvantaged ). 
No less than 30 measures are included in the battery for this study, 
some of which are important modifications of time-tested measures 
whereas others are new measures developed in keeping with the findings 
of the most useful studies in this area over the past decade. 

Also of considerable importance to the understanding of early learning 
is the broader area of developmental studies. It has become increasingly 
evident that we must do more basic research on the nature of the 
developing human being during his formative years in order to under- 
stand and uncover the major dimensions of human growth. Quite 
fittingly, studies of human development open this report — the work of 
Walter Emmerich, Michael Lewis, and (during a year’s leave of absence 
from Clark University) Joachim Wohlwill on the methodology of 
developmental research. Emmerich’s Developmental Study of Social 
Expectations is particularly interesting in this context for the way it 
illuminates how the behavioral expectations of those about us and our 
own expectations interact from our earliest years to help account for 
characteristic needs and behavior at each stage of life. Lewis’ work 
makes use of highly sophisticated laboratory research technology to 
establish basic findings in the study of attentional processes and auto- 
nomic responses in relation to cognitive skills in infants. 



Real Research in the Real World 

Is it possible to do real research in the real world? The answer is, "Of 
course” — but it’s not easy. Not nearly as easy as doing real research 
in an artificial world, such as that provided by many laboratory settings. 
But our times require the frequent departure of the researcher from his 
laboratory into the field, and field studies require many compromises in 
"recommended” attitudes and procedures. A time of rapid social change 
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and swiftly emergent, often baffling, social needs requires an openness 
and a flexibility in researchers for which, unfortunately, few have been 
prepared by specific training. Universities and professors tend to per- 
petuate the techniques they know best and a vested interest grows in 
problems and approaches with which researchers feel comfortable. But 
neither the times nor its problems are comfortable, and so research is 
being forced to change to contend with the challenges posed by social 
change. 

This more open and flexible kind of thinking is operative in many 
studies summarized in this report. In basic psychological studies its 
emphasis is perhaps best reflected by Kogan’s risk-taking studies relating 
to problems of attaining world peace; studies by Ward and others in the 
nature and uses of creativity; Carroll’s studies of our basic social tool, 
language; and Frederiksen’s investigation of the effects of organizational 
climate on managerial requirements. 

An important instance of the change in research emphasis from the 
laboratory to the field appears in the type of study done by the Educa- 
tional Studies Division. The real-world needs of schools that prompted 
Title I program funding, for example, brought on a surge in the need for 
expert evaluation of educational experiments and innovations as well as 
of modified traditional programs. Most studies of this type are, in essence, 
very useful applications of traditional research techniques and experi- 
mental designs flexibly modified to meet the new problems of the times. 
Clustered here generally under early and primary education , secondary 
education , and cultural diversity and the disadvantaged , this research 
includes such studies as Ball’s evaluation of the Children’s Television 
Workshop series ff Sesame Street”; Trismen’s evaluation of an ungraded 
school system in Brevard County, Florida; Campbell’s evaluation of the 
effects of bias in job selection and rating measures; Norton’s evaluation 
of the integration of the Evanston, Illinois, schools ; Zdep’s evaluation of 
school busing in Verona, New Jersey; and Marco and Norton’s evalua- 
tion of Title I programs in Chicago. 

Another feature of this emphasis upon field studies in the real world 
is the attempt to develop new techniques and approaches relevant to real 
educational problems. Here one could mention Anderson’s school read- 
iness criterion study, Diederich’s newspaper tests for social studies, 
Medley’s pioneering work in developing new measures of teacher and 
classroom behavior, and Freeberg’s development of new ability measures 
tailored to the interests and skills of teen-agers in the Neighborhood 
Youth Corps and similar programs. 

A particularly successful phase of this type of effort is the work of 
Peterson, Davis, Hartnett, and Centra in developing measures designed 
to aid colleges in institutional self-study during a time of upheaval in 
higher education. Whether or not the reader is interested primarily in 
higher education, we would urge a perusal of the short reports in the 
higher education category describing the studies of institutional vitality, 
student protest, trustees, and the development of the questionnaire on 



student and college characteristics. 

Of all the ets projects in the "real world,” however, the inost sizable 
— and quite possibly the most significant over the long range — is the 
Longitudinal Study of Disadvantaged Children and Their First School 
Experiences. Involving the thinking of a team of noted national experts 
in the area of early childhood, the efforts of a large task force of ets 
researchers, and the active participation of mothers and other workers 
in black and white communities, this study brings together in one project 
much of what ets research has learned from the past and . aspires toward 
over the years ahead. The study, which began in 1968, plans to follow 
the educational progress of about 1,500 school children through 1974. 
We hope that summaries of Longitudinal Study findings will have much 
of use to report for American education. 



Samuel Messick 

VICE PRESIDENT FOR RESEARCH 



Note 

The source of funds that helped to support research projects sum- 
marized in the following pages is indicated, when appropriate, at the 
end of each summary. Publications resulting from the research arc 
also indicated. Abbreviations are used in both cases. 

These abbreviations represent the following funding sources: 
AftPA — Advanced Research Projects Agency, atgsb — Admission Test 
for Graduate Study in Business, CEEB — College Entrance Examina- 
tion Board, gre — Graduate Record Examinations, hew — Department 
of Health, Education and Welfare, lsat — Law School Admission Test, 
NICHHD— National Institute of Child Health and Human Development, 
nimh — National Institute of Mental Health, nsf — National Science 
Foundation, 0E0 — Office of Economic Opportunity, onr — Office of 
Naval Research, usoe — United States Office of Education, usphs — 
United States Public Health Service. 

These abbreviations represent the following publications: pr — 
Project Report, rb — Research Bulletin, rm — Research Memorandum, 
SR — Statistical Report, tdr — Test Development Report. 

Requests for more information about any project should be ad- 
dressed to the Division of Psychological Studies, Educational Testing 
-Service,— Princeton— New- Jersey. —WJhcn_a , Resear ch Bulletin (rb) is 
listed, more information will be available, but it is often highly tech- 
nical. When no RB is listed, it is quite possible that no additional 
information is currently available. In some cases, projects summa- 
rized here arc works in progress, with publication of results still to 
come. 
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The Parental Role : A Functional- 
Cognitive Analysis. 

WALTER EMMERICH 

A favorite suburban type for novelists 
and sociologists is the middle class 
parent riddled with doubts about his or 
her capabilities as a parent. This study 
is based on the somewhat comforting 
thought that amid whatever familial 
chaos may exist, most parents hold 
reasonably definite beliefs about their 
own role in child rearing and about 
their degree of success or failure in the 
venture. To obtain parental beliefs of 
this type, a Parental Role Question- 
naire (prq) was developed and given to 
103 parents of children attending a 
university nursery school. Measures 
of parental attitudes and personality 
were also used. In this way, profiles 
were obtained of a parent’s socializa- 
tion goals (exactly what kind of person 
does the parent want his child to be- 
come), the parent’s beliefs as to how 
these goals are best achieved, how well 
equipped he is for the socializing task, 
and how successful he feels lie has 
been. One finding was that parents 
tended to favor direct methods to en- 
courage desirable child behavior, and 
indirect methods to discourage un- 
desirable behavior in the child. Perhaps 
most generally useful, however, were 
"the pat ter ii s ' tyi rig^chl Id- rcari n g~bcl i’efs - 
with personality structure in the parent. 
This research should be of interest to 
behavioral scientists concerned with 
family processes, parent-child relation- 
ships, parental attitudes, role theory, 
cognitive processes in social behavior, 
and child development. NICHHD. KB- 
69-65. Also, Monographs of the Society 
for Research in Child Development, 1969, 
34 (8, Serial No. 132). 



A Developmental Study of Social Norms. 
WALTER EMMERICH, KARLA GOLDMAN, 
ROY SHORE 

® We take for granted that most adults 
can distinguish between "appropriate” 
and "inappropriate” social acts. How- 
ever, acquiring such understanding is 
a developmental process about which 




little is known that extends throughout 
childhood and adolescence. This study 
examines social norms held by the self 
and those attributed to significant 
others (parents, peers, males, females). 
Studies with 680 child and adolescent 
subjects indicate that social norms 
vary, depending on whether: (1) the 
holder of the norm is the self or another, 
(2) the holder of the norm is an adult 
or child, (3) the norm is directed in 
action toward a male or a female, and 
(4) the norm is directed in action to- 
ward an adult or a peer. Perhaps most 
important is the finding that norms 
vary systematically according to the 
child’s age, and in some instances also 
according to the child’s sex. The re- 
search should be of interest to be- 
havioral scientists concerned with 
children’s social cognitions and their 
development. It charts "natural” de- 
velopmental trends on which educa- 
tion related to social development 
might build. The study also relates the 
maturity of a child’s social norms to 
various indices of cognitive growth — 
especially academic aptitude test per- 
formance. Findings are relevant to 
questions of the "generation gap,” as 
the study details age changes hi the 
child’s choice of peers versus parents 
as models. NICHHD. 



Personality Development and the Concept 
of Structure. 

WALTER EMMERICH 

As with many other things, how you 
approach the study of human person- 
ality has much to do with what you 

find. This study examines three ap- 
proaches psychologists use in terms of 
how they are similar, or different, in 
their view of the development of per- 
sonality structure. The first approach, 
the classical view, sees personality as 
an unfolding or growth of structures 
according to a relatively fixed sequence 
of possibilities — Freud’s oral, anal, 
genital stages, or the cognitive growth 
stage views of Piaget. A second approach, 
the differential view, sees personality 
development in terms of collections of 
attributes or trails fairly common to 



all of us, but wherein we differ greatly 
from one another — for example, we 
differ in intelligence, in need for 
achievement, and so on. Most testing 
is based on this approach, which was 
initiated by Gallon in Darwin’s time. 
A third approach, actually older in 
some ways than cither of these but 
currently generating interest in new, 
potentially rigorously scientific forms, 
is identified in this study as the ipsative 
view. This approach is associated with 
psychologists such as Gordon Allport 
and examines personality structures in 
terms of individual rather than general 
development. NICHHD. Child Develop- 
ment, Vol. 39, No. 3, September, 1968, 
pp. 671-690. 



Attention Distribution as a Function of 
Complexity and Incongruity in the 
24- Month-Old Child. 

MICHAEL LEWIS, CORNELIA WILSON 

Seeking to discover exactly why very 
small children pay attention to one 
thing rather than another, psychol- 
ogists have tended to standardize a cer- 
tain test procedure. A picture of a 
"jumbled” human face is used in com- 
parison with a "normal” face, and com- 
plexity is tested with a more or less 
. b us y~ c li e c ke rb o a rch paUmx.J^ 
varied that procedure to examine the 
effects on infant attention of using a 
jumbling of the whole human form as 
an incongruity test, and varying the 
number of figures presented as a tcsl 
of complexity. The four pictures pre- 
sented were, for example, (1) of three 
men, for a familiar, complex stimulus, 
(2) of a three-headed man, for an in- 
congruous, complex stimulus, (3) of c 
single man, for a familiar, simple stim 
ulus, and (4) of a man with his hear 
upside down, for an incongruous, sim 
pie stimulus. The results indicated thai 
both complexity and incongruity in the 
human form can affect attention distri 
bution in the 24-month-old child. The 
research should be of interest to devel 
opmental, child, and experimental psy 
chologists studying attentional pro 
cesses. NICHHD. 



MEAN HEIGHT OF STANDARD 



As we grow from childhood into youth, three important determinants of our 
behavior are the norms we have for ourselves, the norms we believe our parents 
have, and the norms of our peers as wc perceive them. This figure shows how 
the relationships of these three norm levels change as the child grows older, 
from age 8 through age 17. (These norms are for behaviors directed toward 
parents; see Emmerich, A Developmental Study of Social Norms.) 
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Allcnlional Distribution as a Function of 
Novelty and Incongruity. 

MICHAEL LEWIS, CORNELIA WILSON 

This study was concerned with seeing 
whether children pay attention dif- 
ferently to stimuli that are defined as 
novel as opposed to those defined as 
incongruous. The underlying purpose 
was to answer a theoretical question. 
From one position it is possible to 
predict not only that a familiar stimulus 
(a picture of a cat or horse, for example) 
would prompt less attention than an 
incongruous stimulus (a cat’s head 
on a horse’s body), but also that a novel 
stimulus (an antcater) would compel 
more attention than either of the other 
two. However, alternative theories 
could be used to support the argument 
that novel and familiar stimuli would 
be fairly equal ill gaining a child’s 
attention, and both would have less 
appeal than the incongruous stimulus. 
One difficulty lies in defining the 
stimuli. The procedure used was to 
rate the children’s verbal responses. 
The results suggest that the nature of 
the verbal response, as well as the 
length of time it takes the child to 
respond, are both related to other 
measures of attention. The results 
were ambiguous, and will be chiefly 
useful in refining the stimuli for an 
improved version of this experiment. 
NICHHD. 



A Developmental StudfTof Learning 
Within the First Three Years of Life: 
Response Decrement to a Redundant 
Signal. 

MICHAEL LEWIS, SUSAN GOLDBERG, 

HELEN CAMPBELL 

Much research has been directed to the 
study of learning. A general definition 
of learning is that it involves changes 
in behavior that result from an inter- 
action with the environment. As in- 
fancy is a time of particularly rapid and 
dramatic changes in behavior, it offers 
a fertile but often bewildering time in 
human development for learning 
studies. One avenue of research that 
can be useful in threading one’s way 
through this maze is the study of 
response decrement or the slackening 
of response to a repeated visual signal. 
This study investigated response decre- 
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ment in children from infancy through 
three years of age. It found that 
response decrement follows a lawful 
developmental pattern within the first 
three years, increasing with age. (This 
phase of the study also suggested that 
this decrement represents a true learn- 
ing phenomenon rather than a fatigue 
model.) It also found that response 
decrement in the young child corre- 
lates with and is predictive of other 
learning tasks and of individual dif- 
ferences in perceptual-cognitive capac- 
ities. In other words, the research sug- 
gests that how children respond to this 
single measure of response decrement 
may he predictive of their abilities in a 
wide variety of intellectual skills. The 
research should be of interest to experi- 
mental psychologists concerned with 
learning and child developmental proc- 
esses. NICHHD. 



Developmental Study of Attention Within 
the First Two Years of Life. 

MICHAEL LEWIS, CORNELIA WILSON, 
MARCIA HARWITZ, PEGGY BAN, 

NANCY VAN WYK 

After a certain amount of initial explor- 
ing of a research area, it often becomes 
desirable to attempt a large, long-range 
study that may integrate a host of 
disparate findings into a useful block 
of knowledge. That is the purpose of 
this study, which got underway in May 
1969. Its specific purposes will be (1) to 
. s t u d y_r es p o 21 s e _d ccr e m e 1 1 t_d evej 0. pjXLe iijl. 
tally during the first two years of life; 
(2) to study cross-modality similarities 
in response decrement — for example, 
visual and auditory modalities; and (3) 
to study the effects of complexity in 
both modalities on response decrement. 
The experiment will use both a cross- 
sectional and a longitudinal design. 
Twenty children will be seen at each of 
six ages: 3, 6, 9, 12, 18, and 24 months. 
The experiment will continue over 
three years, and the results should be 
of interest to developmental, child, and 
experimental psychologists interested 
in attentional processes. NICHHD. 



Play Behavior in the Year-Old Infant: 
Early Sex Differences. 

MICHAEL LEWIS, SUSAN GOLDBERG 
Until recently the emphasis in studies 




of child development was upon nursery 
and early grade school children. It has 
become increasingly apparent, how- 
ever, that many earlier learning expe- 
riences arc more important. The pur- 
pose of this study was to observe 
children at play, interacting with their 
mothers, and especially to note the 
effects of sex differences in this situa- 
tion. Thirty-two boys and thirty-two 
girls, all 13 months old, were observed 
with their mothers in a standardized 
free-play situation. Striking sex dif- 
ferences in the children’s behavior to- 
ward their mothers and in their play 
were noted. Earlier observation of the 
mothers’ behavior toward the children 
when they were six months old indi- 
cates that some of these sex differences 
were related to the mother’s behavior 
toward the children at this early age. 
The fact that such marked sex dif- 
ferences appear within the first year 
has important methodological implica- 
tions for infant research. The findings 
emphasize the importance of checking 
for possible sex differences before pool- 
ing data and of considering sex as a 
variable in any infant research. The 
research should he of interest to experi- 
mental psychologists studying child 
development. NICHHD. 

Perceptual Cognitive Development in 
Infancy: A Generalized. Expectancy 
Model as a Function of the Mother-Infant 
Interaction. 

TTlCHAEL LEWIS, SUSAN GOLDBERG - 

The importance of mothers in the emo- 
tional development of children has long 
been recognized. During recent years, 
however, interest in the effects of 
mothers on a child’s intellectual de- 
velopment has been swiftly growing. 
Out of this research has come the gen- 
eral finding that the amount and the 
variety of stimulation by the mother is 
an important parameter influencing the 
child’s intellectual development. Addi- 
tionally, it can be argued that a relation- 
ship between mother and child that 
leads to a generalized expectancy on the 
part of the child is more important 
than the amount of specific stimulation. 
Mothers and children were observed in 
a naturalistic laboratory situation. It 
was found that the following sequence 
seemed to be of paramount importance: 



Incongruity and complexity of stimuli are two important variables affecting 
attention. These are four of the stimulus cards used by Michael Lewis to study 
how varying these components affects the attention of two-year-olds. (See 
Lewis, Attention Distribution as a Function of Complexity and Incongruity in the 
24-month-old Child.) 
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if i lie m ot b c r res po n d s con sist cn tly and 
(fuicldy to the infant she seems to de- 
velop within him the expectation that 
he can influence his environment 
through his actions. This expectancy 
then seems to provide the motivation 
for additional interact ion with his en- 
vironment that, in turn, stimulates his 
cognitive development. The research 
should he of interest, to child and 
experimental psychologists. NICHHD. 

An Exploratory Study of Resting 
Cardiac Rale and Variability from the 
Last Trimester of Prenatal Life through 
the First Year of Postnatal Life. 

MICHAEL LEWIS, CORNELIA WILSON, 

PEGGY BAN, MARCIA HAH WITZ 

There is evidence that differences in 
our autonomic nervous systems may 
be related to differences in cognitive 
abilities and personality. Specifically, 
the rate of our heart beat has been 
found to vary with our performance 
on a wide variety of tasks, as well as 
with personality differences. If this 
relation could be thorough ly docu- 
mented through research, then it is 
possible that an infant’s heart response 
might become a useful predictor of his 
probable development into childhood 
and even adulthood. This study was 
designed to see if any useful or norma- 
tive relationships between heart rate 
and cognition and personality could be 

_d is c_er ngd from the period before birth 

through the first year of an infant’s life." 
Measurements were made of the heart 
rate of 19 infants at regular intervals 
before and after birth. Despite the 
small sample, interesting developmen- 
tal changes and promising consistencies 
were found, indicating the usefulness 
of further research in this area. The 
research should be of interest to devel- 
opmental child psychologists and to 
physiologists. NICHHD. 

The Cardiac Response to a Perceptual 
Cognitive Task in the Young Child , 

MICHAEL LEWIS, CORNELIA WILSON 

It has been found that a slowing down 
of our heart rate accompanies an intake 
of information and that our hearts beat 
faster during mental elaboration of this 
information, or when we wish to exclude 
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information. Using 44 one-month- 
old children, this study sought to find 
out whether the heart beat would slow 
down as the children solved a simple 
perceptual discrimination task, and also 
whether the degree of slowing down 
might he related to the accuracy of the 
response. There were several specific 
findings of some complexity. However, 
in general it was found that the degree 
to which the heart rale slowed down 
was significantly related to the child’s 
general intellectual functioning as 
measured by a standard IQ test. Im- 
portant and consistent sex differences 
in cardiac responsivily were also found 
— infant girls showed greater con- 
sistency of response systems, for ex- 
ample. The results suggest that, at least 
for very young girls, cardiac decelera- 
tion is directly related to both general 
intellectual capacity and efficiency. The 
research should be of interest to psycho- 
physiologists and child psychologists. 
NICHHD. 



Cardiac Responsivily to Tactile 
Stimulation in Waking and Sleeping 
Infants. 

MJCilAF • LEWIS, CORNELIA WILSON, 

MARCIA IL.J .rrz 

A harrowing problem for researchers is 
that of important but overlooked vari- 
ables. Known as confounding variables, 
they can sometimes undermine the 

~ work - of—months-and -even-years. A 

problem in the relatively new field of 
studying infant psycliopliysiologica! 
responses is that few studies have paid 
much attention to whether the infants 
were awake or asleep when tested. 
Hence, if there are clearly response 
differences between the two states, not 
only would this be a crucial variable to 
control in future work, but it could 
also render questionable much work in 
the past. This study sought to deter- 
mine whether there are in fact cardiac 
response differences between waking 
and sleeping infants. Clearly discern- 
ible differences in response between 
the two states were found, indicating 
that sleeping or waking state differences 
must be accounted for in future studies. 
The research should be of interest to 
psychophysiologists and developmental 
child psychologists. NICHHD. 




The Meaning of an Orienting Response: 
A Study in the Hierarchical Order of 
Attending. 

MICHAEL LEWIS, MARCIA IIAKWITZ 

I ii t he prog rcss i vc I y fi ncr d i fie re nl iat i o n 
of the important components of at Uni - 
tional processes, what is known as l lie 
orienting response (oh) lias captured 
the interest of numerous researchers. 
The on is involved in the lulling or 
focusing of attention that readies one 
for perceiving whatever il is that has 
caught one’s attention. This study 
sought to reveal the inadequacy of 
present ihcory in this area, and to 
present alternatives. The specific ques- 
tions explored were whether all dis- 
cri mi liable stimulus changes produce 
the same degree of orienting response, 
and whether the degree of the or de- 
pends on the salience of a particular 
stimulus. A visual signal was used, 
followed by variations of the signal 
that changed in color, size, number, 
and rotation. The results indicate a 
definite hierarchy of stimulus salience 
which is, in turn, related to a subject’s 
mental structure and conceptual de- 
velopment. That is, the different stimuli 
prompted different responses from dif- 
ferent people, rather than the tendency 
toward a sameness that would have 
been predicted according to prevalent 
theory. The results arc used to argue 
for a theoretical model of attending 
that takes cognitive principles into 
account in explaining the orienting 
■“response;- -The- research- should -be -of 
interest to experimental, child, and 
developmental psychologists interested 
in aHentiena] processes. NICHHD. 



The Magnitude of the Orienting Response 
in Children as a Function of Changes in 
Color and Contour . 

CORNELIA WILSON, MICHAEL LEWIS 

A difficulty with present theory for the 
orienting response is that it cannot ho 
used to predict the magnitude of 
changes in the OR for various stimulus 
conditions. This study explored the 
effects of varying sucli stimulus dimen- 
sions as color and contour. A stimulus 
was shown six times, and then akcred 
on the seventh presentation. The in- 
vestigators were interested in how 



accompanied by use of a "Language 
Master” (a device for presenting brief 
auditory samples along with printed or 
pictorial material). It was found that 
translations were superior to pictures 
in promoting grammar learning. It 
was also found that a confirmation 
rather than a prompting mode of prac- 
tice was superior — that is, let- 
ting the child know he is definitely 
right or wrong as he makes each re- 
sponse, rather than prompting him to 
"discover” the right response after a 
period of some mystery. Besides their 
psycholinguistic relevances, the find- 
ings may have implications for the 
teaching of reading. The research 
should be of interest to foreign lan- 
guage teachers, especially those teach- 
ing young children, and to those con- 
cerned with the psychology of language 
learning. NICHHD. KB-68-43. 

Factors in Comprehension of Verbal 
Material. 

JOHN B. CARROLL, ROY 0. FREEDLE 

This program of research defines fac- 
tors that may account for the way we 
comprehend spoken and written lan- 
guage. Materials include items from 
standard reading and listening com- 
prehension tests. The presentation of 
stimuli is controlled by several ad- 
vanced research methods, such as the 
use of compressed speech techniques. 
Three studies during the time period 
of this report-made interesting progress.- 
"Children’s Imitations of Sentences 
Evaluated by FourResponseMeasures,” 
by Roy Freedle, Terrence Keeney, and 
Nancy Smith, investigated pre-school 
age children’s "telegraphic speech.” 
Previous investigators had theorized 
that children omit function words and 
certain grammatical features because 
they have small memory spans and are 
not sensitive to these grammatical ele- 
ments. This study suggests that these 
previous explanations are inadequate 
and probably wrong. Results are de- 
scribed in RB-69-79, and will be pub- 
lished in the Journal of Verbal Learn- 
ing and Verbal Behavior. "Observa- 
tions With Self-Embedded Sentences 
Using Written Aids,” by Roy Freedle 
and Marlys Craun, explored the ques- 
tion of why people normally find self- 
embedded sentences with two or more 



embeddings so difficult to understand. 
(A self-embedded sentence contains one 
or more sentences embedded within 
it; for example, "The woman whom the 
boy helped Was tired” contains one em- 
bedded sentence.) Results are described 
in RB-69-22, and will be published by 
Perception and Psychophysics. "Some 
Interrelations Among Nouns: The Pur- 
suit of Semantic Markers,” by Roy 
Freedle, investigated questions of how 
categorization of words (nouns) allows 
one to discover the nature of semantic 
markers experimentally. Such markers 
have been proposed as one means by 
which we understand sentences. Freedle 
found two distinct groupings were 
produced by the experimental sub- 
jects, suggesting that if hierarchies of 
semantiemarkersexist, they presumably 
differ from individual to individual. 
The research should be of interest to 
psycholinguists and teachers of Eng- 
lish and foreign languages. All three 
studies are supported by NICHHD. 

Learning from Verbal Discourse in 
Educational Media. 

JOHN B. CARROLL 

As research in any area proliferates 
there generally arises a need to inte- 
grate findings and state what appear to 
be useful principles underlying many 
phenomena. Such a need has arisen in 
the study of verbal discourse, partic- 
ularly because of the relevance of work 

i n this area t o _t h e_d eyel o pment o f in - 

structional methods employing modern 
technologies such as film, television, 
tape recordings, programmed instruc- 
tion, and teaching machines. Uncover- 
ing principles that might guide de- 
velopers of such devices could be 
extremely helpful at this time. This 
study reviewed some 1,500 references 
in the literature to identify major find- 
ings as well as major gaps in knowledge. 
An objective of the study, which is not 
complete yet, is the development of an 
appropriate theoretical orientation to 
the material. The completed study 
should be of interest to educators in 
general, including classroom teachers, 
textbook and curriculum writers, film 
and videotape producers, and specialists 
in the psychology of learning or the 
psychology of language. USOE, RM-68-2. 
RM-69-11. 



Application of the Lognormal Model 
of Word Frequency Distribution. 

JOHN B. CARROLL 

One useful way of studying language is 
by determining word frequencies, or 
bow often certain Words will appear in 
characteristic expressions that are un- 
der study. This approach makes pos- 
sible the portrayal of findings in terms 
of word frequency distributions that 
can be shown graphically or put into 
mathematical formulae. The purpose of 
this study was to gain a better under- 
standing of word frequency distribu- 
tions in order to be able to predict from 
them the size and diversity of vocabu- 
laries. A number of models of word 
frequency distribution have been pro- 
posed, including the mathematical 
transformation known as the lognor- 
mal distribution. However, the ration- 
ale for a lognormal distribution had not 
previously been developed. A mathe- 
matical model was developed, along 
with computer programs to test the 
model on extensive data. The most 
notable finding was that the lognormal 
distribution does provide an adequate 
fit to the data and can be used to predict 
vocabulary size and diversity. The 
study is relevant to education in that, 
in a general way, its findings could help 
define the vocabulary load in curricula 
in English and foreign languages. The 
findings also have applications in the 
stylistics of written composition. The 
research should be of interest to psy- 
cholinguists, —mathematical psychoL. 

ogists, and educators concerned with 
the teaching of vocabulary either in 
English or in foreign languages. 
NICHHD. RB-69-90. 

Training of Cognitive Functions 
in Children. 

PAUL I. JACOBS 

This study sought to find out to what 
extent children’s intelligence can be 
increased by training. A notable find- 
ing was that the cognitive skill ol 
double-classification can be taught in 
such a way that it transfers to new 
materials and is retained over at least 
four months. Another aspect of interest 
was that a taxonomy of logical relation! 
was needed to evaluate attempts tc 
teach the cognition of figural relation. 



quickly the child became bored with 
the repeated stimulus (or response 
decrement), and how readily he re- 
sponded to the change on the seventh 
trial (or response recovery). The find- 
ings revealed more boredom with a re- 
peated achromatic stimulus than with 
a chromatic stimulus but no differences 
in response decrement were evident 
for a comparison of curved line versus 
straight line stimuli. There Was also 
greater response recovery for the 
change from black and while to color 
than the reverse, and greater recovery 
for the change from a straight line to a 
curved line stimulus than the reverse. 
The research should be of interest to 
child development researchers study- 
ing the orienting response. NICHHD. 

Methodology and Research Strategy in 
the Study of Developmen tal Change . 
JOACHIM WOHLWILL 

For the same reason that histories arc 
written to explain nations, and bio- 
graphies to explain individuals, psycho- 
logical researchers are concerned with 
the developmental view of man, which 
examines how we change over time. 
The problem of measuring change for 
the psychologist is so complex, how- 
ever, that relatively little completely 
satisfactory developmental research is 
carried out. This study systematically 
approaches the problem for the re- 
searcher examining problems of meth- 
od ol ogy—researeh-desigivdata.anaLysis, 
and scientific inference. In particular 
attention is given to: (a) the measure- 
ment of changes along behavioral di- 
mensions over extended periods of 



Studies of the Acquisition of Grammar 
in a Foreign Language. 

JOHN B. CARROLL 

An unresolved question for psycho- 
linguists is whether an "audiolingual 
habit formation” theory or a "cogni- 
tive Code learning” theory is most ap- 
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time, (b) problems of longitudinal ver- 
sus cross-sectional data-gathering 
models, (c) describing and analyzing 
the developmental function, (d) ana- 
lyzing interrelationships among vari- 
ables over the developmental course, 
(e) applying experimental methods to 
the study of developmental functions, 
and (f) integrating thesludy of develop- 
mental changes with the study of indi- 
vidual differences. The research should 
be of interest to developmental and re- 
search psychologists generally. RM-69- 
24. RB-69-40. A book on the subject is 
being written by Dr. Wohlwili. 

A Longitudinal Study of the Formation 
of Concepts of Conservation and 
Classification , as Related to the 
Development of Spontaneous Cognitive 
Activities . 

JOACHIM WOHLWILL 

The work of Jean Piaget lias trans- 
formed developmental psychology by 
providing a central body of theory and 
an array of concepts that have opened 
many avenues for research. This study 
was an attempt to relate fundamental 
Piagetian concepts to spontaneous 
childhood activities over a period of 
time. Specifically, the purpose was to 
assess changes in children’s responses 
to tasks of conservation, class-inclu- 
sion and class-intersection over an 18- 
month period, and to relate these to 
changes in their approach to situations 
that cal) for spontaneous activities in- 
volving ordering, measuring, and classi- 
fying. Tests of 94 children who were in 
Kindergarten and Grade 1 at the start 
of the study indicate a relationship be- 
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propriatc for guiding foreign language 
learning. That is, can foreign languages 
best be taught by the drilling of great 
numbers of words and speech pattern 
equivalents or by teaching a relatively 
smaller number of grammatical rules 
for making sentences? This is one of a 
series of studies aimed at finding 



tween conservation and measuring 
activities — a minimal level of profi- 
ciency in measuring seems necessary 
for advances in conservation to occur. 
Similar though less clear-cut relation- 
ships have been found between class- 
intersection and conservation. The re- 
search should be of interest to child 
and developmental research psychol- 
ogists. 

Memory Systems in 
Young Children. 

GERALD W. BUACEY 

There is no appreciable body of re- 
search on memory in young children. 
This project was a pilot study to remedy 
this situation by using a new technique 
for assessing rate of forgetting with a 
set of culture fair materials, which can 
be standardized for any culture. Other 
instruments were used to study the 
organization of memory. Not enough 
data were collected to yield conclusive 
findings; however, the following indi- 
cations are noteworthy: (1) the for- 
getting curve was very steep, (2) or- 
ganization of short term memory ap- 
pears to be very rigid, and (3) failure 
to recall appears to be a problem of re- 
trieving a stored item, and not a prob- 
lem of storing the item. The research 
should be of interest to developmental 
psychologists, experimental psychol- 
ogists interested in memory, and pos- 
sibly teachers. It also has some bearing 
on memory work with adults. Further 
research of this type may be relevant 
to education in suggesting optimal 
rates for the presentation of informa- 
tion by teachers or machines. 



answers to various phases of this gen- 
eral question. Specifically, this study 
sought to discover whether children 
learn a foreign language more easily by 
seeing picture sequences that illus- 
trate sentence patterns, or by transla- 
tions into their own language. An indi- 
vidualized instruction method was used, 
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domain of intelligence. This taxonomy 
has been developed. Previous attempts 
to train intelligence have generally not 
clearly defined the training procedure 
nor specified the relations between 
operations used for training and those 
used for measuring intelligence. This 
approach takes care of both needs. The 
research should be of interest to devel- 
opmental psychologists, curriculum 
builders, and geneticists. It is partic- 
ularly relevant to the controversial 
conclusions of Dr. Arthur Jensen 
which, as he admits, apply only to 
presently known environments. As new 
manipulations of the learning environ- 
ment are successful in increasing in- 
telligence — as this study appears to 
have demonstrated — it may be ex- 
pected that Jensen’s pessimistic con- 
clusions will be modified. The research 
also seems relevant to education in 
that, if intelligence can be trained, 
logically there should be a place for 
such training in the curriculum. The 
research is also relevant to the Head 
Start Program and generally to the 
issues of compensatory education. 
NIGHHD. RB-68-65. RB-69-20. RB-69-88. 

Human Choice Behavior, 

ROY O. FREEDLE 

A common plaint of educators is that 
for all the research that has gone into 
human learning we still know very little 
about it. Actually a very detailed 
knowledge of human learning processes 
has been accumulated over the years, 
but a great problem today is how to 
reduce this accumulation to something 
relatively clear theoretically — both to 
expose areas that need more research, 
and to communicate to educators what 
is actually known of learning. The goal 
of this project is to develop data-reduc- 
ing theoretical capsules of this nature 
in a variety of experimental settings. 
Specific learning phenomena being 
explored include paired-associate learn- 
ing, human probability learning, syntac- 
tic and phonemic recognition studies, 
and more general psychophysical sen- 
sory discrimination studies. One ap- 
proach being used is the analysis of 
synthetic asymmetric confusion mat- 
rices using a modified input to the 
Shepard-Kruskal computer scaling pro- 



gram. Research to date indicates that 
this program will recover the specially 
constructed "double” configurations 
which seem to account in part for 
asymmetric matrices. RB-70-40. 
NICHHD. 

General Choice Theory. 

ROY 0. FREEDLE 

A second phase of the general probe 
launched in "Human Choice Behavior” 
involves Luce’s choice axiom. When 
this axiom is recast in terms of the pro- 
portion of time spent in making, say, 
manipulative or observing responses, 
it appears to provide a way of studying 
its applicability to an infant’s atten- 
tional behavior. It also seems to pro- 
vide a means of indirectly determining 
whether the infant perceives sub- 
groupings of specially constructed 
multidimensional stimuli. A second 
aspect of general choice theory con- 
cerns a modification of Luce’s theory 
in a different direction. This revision 
deals with a quantitative account of 
the effects of "irrelevant” stimuli and 
anchor stimuli on response probabil- 
ities for choices made from the avail- 
able set of responses. When completed 
the research should be of interest to 
researchers in cognition and human 
learning. RB-69-89. NICHHD. 

Human Probability Learning. 

ROY 0. FREEDLE 

A third phase of the "Human Choice 
Behavior” study involves probability 
learning. Two studies tested an assump- 
tion based on the learning model known 
as the k-span learning model. The as- 
sumption in this case concerns the 
subject’s memory of the last k events 
and the effects this information exerts 
on his subsequent choices. The evalua- 
tion of the memory assumption for k 
events indicates that a subject per- 
forms best on patterns of k events 
which involve few runs and performs 
worst on patterns involving many runs 
(with the exception of those patterns 
which involve a regular alternation of 
events). This indicates that the k-span 
learning model must be modified to 
account for such findings. RB-69-4. 
NICHHD. 



Teacher Bias and Expectancies. 

LEONARD S. CAHEN 

For years it has seemed apparent to 
many observers that a teacher’s high 
expectations influenced a student to 
greater performance while low teacher 
expectancies worked against a good 
showing by the student. Two fairly 
recent developments have spurred re- 
searchers to go beyond unsupported 
personal observations to try to estab- 
lish — or disestablish — the phenomena. 
One goad has been the frequent con- 
tention of observers in ghetto schools 
that low teacher expectancies, or a 
negative bias, was depressing the per- 
formance of the black students in these 
schools. The other goad has been an in- 
creasing number of experiments which, 
oil one hand, are establishing the 
phenomenon as indeed very much 
operative, blit on the other hand, are 
raising a great many questions about 
exactly how it does and docs not 
operate under varying circumstances. 
The purpose of this study is to con- 
struct a theoretical model for experi- 
mental testing. An extension is pro- 
jected beyond studying elementary 
school teacher-pupil interactions to a 
study of secondary school teachers. 
One finding to date is that the amount 
of bias attributed to manipulated ex- 
pectancies seems to be a function of 
the amount of information given to the 
teacher to establish the expectancy. 
When completed, the research should 
be of interest to educational and social 
psychologists and researchers. 

Estimation of Spelling Difficulties. 

LEONARD S. CAHEN, MARLYS J. CRAUN, 
SUSAN K. JOHNSON 

Spelling difficulties arise from numer- 
ous causes. This study is investigating 
spelling difficulty in terms of the stim- 
ulus properties of words and various 
cultural and psychological aspects of 
language. A review of the literature has 
led to the first phase of a model to 
predict spelling difficulty. The model 
involves a tentative list of 23 predictor 
variables, such as length of word, word 
complexity, and number of perceptual 
breaks in the word. The long-range pur- 
pose is to see how well the model will 
(i continued on page 35) 



TREE STRUCTURE OF 
ASSOCIATIONS TO LIGHT 



How complex research in human learning has become is 
suggested by this chart. Shown are the hypothetical cogni- 
tive operations of two different individuals responding to 
the question u What word do you associate with the word 




n 








'light’?” Each person interprets this stimulus word (shown 
at the top of the diagram) as having a certain meaning and 
being a certain part of speech. Then the two may carry out 
quite different evaluations in terms of the grammatical and 



semantic alternatives open to them. The hypothetical end 
result is a word-association response of ' dark” in one ease, 
and "Edison” in the other. (See Carroll, Application of the 
Lognormal Model of Word Frequency Distribution .) 
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C PROGRAM GNLOGN GENERATES LOGNORMAL AT DEPTH D 

DIMENSION F(46), X(200), SPK(46) 

DOUBLE PRECISION DXI,CP 

REAL NU, MUTAU, NT, MU, NTYPES 

INTEGER EN, F, CFK,I0DD(2)/ZD549672A,ZE5C94642/ 
CALL START ( ) 

CALL S ETC L K 



Y 1 = — ( CLOCK ( A ) )/ lOOOOOO. 

WRITE(6,999) Y1 

999 FORMAT ( 9X, 14HSTART ING T IM E= , F 14 .6 , 8H SECONDS) 

1C YI=— (CLOCK(B) )/1000000. 

C I NS T 1= 1 , CONSTANT DEPTH; =2, POISSON DEPTH 
C I NST2= 1 , TYPE DATA? =2, TOKEN DATA 

R EAD ( 5 , 2 5 ) LAB EL 1 , LABEL2, LABEL3, EN , NU , D, MU, SIGMA, INST1, I 
1NST2 , INST3 
I F ( EN.EQ.O) GO TO 1 
MUTAU=MU-SIGMA**2 
NTYPES=EXP ( .5*SIGMA**2-MU) 

11 WRITE (6,19) 

12 WRITE( 6 ,20) LABEL1,LABEL2,LABEL3, EN , NU , D, MUTAU , SI GMA, MU, NTYPES 

13 IF( INST1.EQ.1) WRITE(6, 1013 ) 

14 IF< INST1.EQ.2) WRITE (6 , 1014 ) 

17 IF (1NST3.EQ.2) WRITE (6,1017) 

1017 FORMAT (25X,18HWITH CONSTANT P=.5) 

15 IF( INST2.EQ.1) WRIT E (6 , 1015 ) 

16 IF( INST2.EQ.2) WR I T E ( 6 , 1 016 ) 

1013 FORMAT! 1H0 ,20X , 27HG EN ERAT ED AT CONSTANT DEPTH) 

1014 FORMAT ( 1H0,20X ,35HDEPTH CONTROLLED BY POISSON PROCESS) 

1015 FORMAT ( 25X,30HDATA ARE FOR TYPE DISTRIBUTION/)- ' 

1016 FORMAT (25X,31HDATA ARE FOR TOKEN D I STRUBUT ION/ ) 

19 FORMAT ( 1H1 , / / , 2 8X , 2 HEN , 6X , 2HNU ,9X, 1 HD , 7 X , 5HMUT AU , 5 X , 5 HS I GM A , 8X , 2HM 
1U,8X,6HNTYPES) 

20 FORMAT! 4X,3A4,6X, I10,5F10.4,F12.2) 

25 F0RMAT(3A4, I i 0 , 4F 10 .4 , 2 X , 3 1 1) 

IF ( INST3.EQ.2 ) GO TO 28 
FNU= . 5 ** ( (NU-1 . ) /NU) 

FNU2= 1 . /NU 
28 SLNP=0 • 

SLNP2=0 . 

N= 0 



IF! INST2.EQ.2) MUTAU=MU 
C FK = 0 . 

SP = 0. 

SSPK=0. 

I D= 1 . 0000 1 *D 
I DP 1= I D+ 1 
C EXPD= EXP ( — D ) 

DO 30 K= 1 , 46 
SPK ( K ) =0. 

30 F ( K ) =0 

Y2 = -( CLOCK ( Cl ) ) /lOOOOOO. 
ET=Y2— YI 



Basic psychological research now frequently requires elaborate 
computer programming. This is a sample portion of the program 
(gnlogn) for the Monte-Carlo generation of terminal distribu- 
tions in a word-frequency distribution study by John Carroll. 
(See Carroll, Application of the Lognormal Model of IFord 
Frequency Distribution.) 



WRITE(6,1000) ET 





predict actual spelling difficulties, as 
reported by Greene’s New Iowa Spelling 
Scale of 5,507 words. When completed, 
the research should be of interest to 
educational researchers. HI3-69-72. 

General Ability of Analytic Style . 

LEONARD S. CAHEN 

It has been found that how wc approach 
or analyze problems may show consist- 
encies according to the individual that 
can be characterized as analytic styles. 
The purpose of this study is to see how 
such styles relate to other cognitive and 
personality phenomena. The approach 
being used is based on Jerome Kagan’s 
Matching Familiar Figures (mff) Test, 
which has been found useful in identi- 
fying four kinds of analytic style: im- 
pulsive, reflective, quick responding, 
and slow responding. Students in the 
study have been asked to provide 
matchings that were the same as and 
matchings that were different from the 
stem or basic figure. Measures of the 
number of errors and response latency 
— or how long it takes them to respond 
— are being compared. A preliminary 
analysis of the data indicates that the 
dimension of latency is more stable 
within and across measures than the 
assessment of errors. The research 
should be of interest to researchers in 
cognitive and learning studies. 

Recall of Approximations to English. 
JOHN J. FREMER 

Most of us take speech for granted, but 
to the psychologist the process where- 
by human beings dip into memory and 
bring up the right word or words in 
speaking is of a wondrous complexity. 
This study tried to uncover the rela- 
tionship between the ability to recall 
unrelated words, and the ability to 
make use of contextual constraints as 
aids to recall. The comparisons were 
made with deaf children, and with hear- 
ing children from both disadvantaged 
and middle-class backgrounds. The 
data are still being analyzed; however, 
a preliminary analysis indicates that 
older middle-class children show an 
increased ability to make use of con- 
textual constraint throughout the range 
used in the study. There appeared to be 







a ceiling, however, to the level of con- 
textual constraint that could facilitate 
recall by deaf children. The research 
should be of interest to those interested 
in language, memory, verbal mediation 
research, educational psychologists, 
and teachers of the deaf and the cul- 
turally disadvantaged. One educational 
implication is that it may be possible to 
identify children whose ability to use 
language cues as an aid to recall is 
poorly developed relative to their 
ability to recall unrelated words. 

The Influence of Response Time and 
Stimulus Discriminability on Children s 
Dimension Preferences. 

GORDON A. HALE 

In many ways the eye is like a tunnel 
leading from the outer world into the 
inner world of our minds. Thus, the 
nature of its "gatekeepers” is of endur- 
ing interest to researchers. It is known 
that in carrying out their screening 
function, the perceptual "gatekeepers” 
evaluate the entering stimuli in terms 
of such dimensions as size, shape, 
color, texture, and so forth. This study 
sought to determine to what degree 
these evaluations are fixed and rela- 
tively inflexible, or whether they can 
be modified. A "dimensional prefer- 
ence” test was used whereby the pres- 
entation of stimuli was automated to 
carefully control both the duration of 
the stimuli and the time allowed the 
observer to respond to them. One find- 
ing was that to a high degree the tested 
kindergarten and third-grade children 
evaluated stimuli in terms of' shape 
rather than color or other dimensions. 
This shape preference was also rela- 
tively fixed and hard to modify. The 
research is relevant to the problem of 
devising teaching materials that are 
based on an understanding of how chil- 
dren attend to certain features of the 
materials that arc critical for learning. 
It should be of interest to educational 
and experimental psychologists. 

Interrelations Among Paired Associate 
Learning Tasks Involving Verbal and 
Pictorial Material. 

GORDON A. HALE 

Research has found that learning pro- 




ceeds more rapidly when the tasks in- 
volve pictorial rather than verbal ma- 
terials, suggesting that the use of 
imagery facilitates learning. While 
previous research has indicated overall 
differences in the rate of learning for 
pictorial versus verbal materials, more 
needs to be known about the relation- 
ships between these two types of ma- 
terials in relation to the learning proc- 
esses. This study explored such ques- 
tions and found a high correlation be- 
tween two tasks involving pictorial 
materials — one abstract, and the other 
concrete. In contrast, it found a low 
correlation between two tasks involving 
verbal materials. The findings suggest 
a greater degree of diversity in the 
abilities required for learning verbal 
associations than in the abilities re- 
quired for nonverbal learning. The 
research should be of interest to ex- 
perimental psychologists and educa- 
tional psychologists. 



Children's Retention of Paired, 

Associate Learning Materials 'as a 
Function of Method of Presentation. 
GORDON A. HALE 

This study was concerned with the 
effects of the method of presentation 
upon long-term retention in terms of 
interference theory. This is a long- 
standing theory which explains for- 
getting as a matter of old memories 
"interfering” with new memories, or 
vice versa. W. F. Battig, however, has 
proposed a hypothesis based on this 
theory that is somewhat counter to the 
theory’s general thrust. It states that 
the amount of material children retain 
is influenced by the extent to which 
interference has been created among 
the items to be learned. Contrary to this 
prediction, this study found that condi- 
tions of low interference among items 
produced better retention than high 
interference conditions. The research 
should be of interest to educational 
and experimental child psychologists. 
It underlines the need to consider 
long-term retention as well as rate of 
learning as measures of learning, and is 
relevant to the development of pro- 
grammed texts and computer-assisted 
instruction. 
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Children's Imitation of Utterances. 
TERRENCE J. KEENEY 

Studies with young children comparing 
their imitation, comprehension, and 
production of speech generally show 
that their capacity for imitation is far 
superior to their ability to comprehend 
or produce speech. Under the assump- 
tion that the only sure measure of 
grammatical knowledge is comprehen- 
sion, however, imitation has usually 
been dismissed as an uninteresting and 
probably irrelevant experimental task. 
This study sought to determine whether 



Perceptual Factors in Cognition arid 
Personality . 

SAMUEL MESSICK, JOHN W. FRENCH 

This study explored how our percep- 
tion relates to thinking and feeling, or 
more technically and specifically, how 
individual differences in the speed and 
flexibility of closure in perception 
relate to cognition and personality. It 
is known, for example, that those who 
quickly report seeing definite shapes in 
perceptual tests and then hang fixedly 
to these first perceptions in the face of 
changing evidence often have some- 
what different personalities and ways of 
thinking from those who are slower to 
gain closure and more flexible in their 
reports. In this study experimental 
tests of verbal and cognitive closure 
and of flexibility in reasoning and 
problem solving were developed. These 
measures were included in a battery of 
personality and ability measures given 
to more than 500 cadets at the U. S. 
Naval School of Aviation Medicine in 
Pensacola, Florida. A factor analysis 
isolated 14 factors relevant to the in- 
vestigation in terms of speed or flexi- 
bility of closure in three performance 
areas: perceiving, thinking, and verbal 
expression. By means of statistical 
manipulation, these 14 factors were 
then reduced to four second-order 
factors: verbal comprehension, general 
reasoning, figural articulation (that is, 
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a child’s imitation of various forms of 
speech might, in fact, tap or make con- 
tact with his grammatical knowledge 
after all. Four-year-old children imitated 
strings of nonsense syllables (to see if 
lexical meaning was being tapped), 
strings of words (to see if grammatical 
meaning was being tapped), and gram- 
matical sentences (as a control meas- 
ure). The most notable finding was 
that imitation did indeed relate to the 
grammatical system of the young child, 
and to the lexical meaning system as 
well — the imitation of ungrammatical 
utterances was less accurate and slower 



Personality 



facility in structuring and differentiat- 
ing figural stimuli), and symbolic artic- 
ulation. The research should be of 
interest to personality researchers. 
ONR. 

Personality Organization in Cognitive 
and Social Processes. 

SAMUEL MESSICK 

This project is an attempt to deal with 
the interrelationships of personality, 
cognition, and social processes through 
a series of integrative studies that build 
from fairly specific projects to larger, 
more inclusive investigations. The 
studies range from fairly limited experi- 
mental investigations using only a few 
measures and relatively small samples 
of subjects to large integrative studies 
involving large samples of subjects, 
each of whom was administered more 
than 18 hours of testing. Something of 
the complexity and size of the project 
is perhaps best indicated by simply 
listing study areas, co-investigators, 
and publications. The studies were: 
"Categorizing Styles and Cognitive 
Structure,” Nathan Kogan ( Perceptual 
and Motor Skills , 1963, 16, 47-51, and 
1965, 20, 493-497). "Cognitive Com- 
plexity: Dimensions of Role Con- 
structs,” Nathan Kogan (Multivariate 
Behavioral Research, 1966, I, 165-175). 
"Leveling-Sharpening and Assimila- 
tion Tendencies,” Fred Damarin and 




than ihe imitation of grammatical 
utterances. The significance of this 
finding is that it seems to indicate that 
imitation might be used as a measure of 
grammatical knowledge. This in turn 
opens the possibility of studying the 
development of the child’s grammar at 
very early ages (114 to 3 years) when 
comprehension measures arc difficult 
to obtain and recordings of spontane- 
ous speech underestimate a child’s 
grammatical knowledge. The research 
should be of interest to psycholin- 
guists, child psychologists, and educa- 
tional psychologists. NICHHD.RM-69-12. 



Virgil McKenna (RB-68-28). "Toler- 
ance for Unrealistic Experiences,” 
Norman Cliff. "ScanningandFocusing,” 
Harold Schiffman and Diran Dermen. 
"Cognitive Styles, Defenses, and Eye 
Movements,” Lester Luborsky, Harold 
Schiffman, and Diran Dermen. "Style 
and Persuasibility,” Fred Damarin. 
"Sex Differences in Cognitive and Per- 
sonality Structure,” Diran Dermen. 
"The Stability of Cognitive Styles and 
the Correlates of Change,” Diran 
Dermen. "Dimensions of Analytic Atti- 
tude,” Ferdinand Fritzky, Douglas 
Jackson, and Charles Myers, (Journal 
of Personality , 1963, 31, 346-370; Edu- 
cational and Psychological Measurement, 
1964, 24, 177-192; Journal of Abnormal 
and Social Psychology, 1964, 69, 313- 
318). "Cognitive Interference and 
Flexible Control.” NIMH and NICHIID. 

Desirability Judgments and Inventory 
Responses. 

SAMUEL MESSICK 

In the Thurstone method of construct- 
ing attitude scales, a number of ex- 
perts are asked to judge the degree to 
which various statements reflect a 
particular attitude. An important find- 
ing some years ago was that the judges 
varied considerably and reliably in the 
ways in which they rated the various 
statements, the original study being of 
differences between judgments by 



Negroes, pro ‘Negro whites, and anti- 
Negro whites. Since then a number of 
studies have explored the possibility 
that such judgments may prove superi- 
or to self-report measures for assessing 
personality — that they would reflect 
the personality of the rater as well as 
the properties of the items being rated. 
This study compared desirability judg- 
ments with personality inventory re- 
sponses on the same items to ascertain 
the degree of possible overlap. That is, 
the subjects were asked at one time to 
judge the items for desirability and at 
another time to respond to a question- 
naire that used the same items in the 
customary way. Correlations between 
desirability judgments and inventory 
responses were found to be sizable and 
systematically related to the level of 
the judged item desirability. Specifical- 
ly, items judged to be extremely desir- 
able or undesirable showed low corre- 
lations with inventory responses, 
whereas items within a broad neutral 
range of desirability showed substan- 
tial correlations with the responses. 
Factor analyses indicated that both 
similarities and differences exist be- 
tween dimensions of judgment and di- 
mensions of response. Judgment-re- 
sponse correlations were computed 
separately for each subject, with the 
finding of significant correlations with 
scales measuring defensiveness and the 
tendency to respond desirably. The 
research should be of interest to per- 
sonality researchers and test develop- 
ers. RM-64-13. USPHS. 

Judgmental Dimension s of Desirability 
and Frequency of Occurrence in the 
Prediction of Response Factors. 

SAMUEL MESSICK 

The purpose of this study was to solve 
two interrelated problems: one, the 
identification of the components of the 
largest factor of personality inventories 
such as the Minnesota Multiphasic 
Personality Inventory (mmpi) ; and, 
two, evaluation of the use of consisten- 
cies in judging item properties as pos- 
sible sources of valid data about charac- 
teristics of judges. The first problem 
was approached by considering judged 
desirability and two alternative eon- 
notative properties of items, the judged 
frequency of occurrence of the trait 







represented by the item and the judged 
frequency of endorsement of the item. 
The second problem was approached 
by evaluating the degree to which indi- 
viduals judged items differentially un- 
der alternative instructional sets. The 
results of this complex study should be 
of interest to personality researchers 
and are described in the article, tf A 
Distinction Between Judgments of Fre- 
quency and of Desirability as Deter- 
minants of Response,” in Educational 
and Psychological Measurement , 1969, 
29, 273-293. The study was done in 
collaboration with D. N. Jackson of the 
University of Western Ontario. 

USPHS. 

Judgmental Dimensions of 
Psych opath ology. 

SAMUEL MESSICK 

When consistent individual differences 
in judging the desirability of person- 
ality statements were first uncovered, 
it seemed that these judgmental con- 
sistencies might serve as personality 
variables in their own right; i.e., that 
individual viewpoints about the de- 
sirability of certain personality charac- 
teristics might indirectly reflect con- 
sistencies in the personality or social 
values of the judges. This point has 
considerable methodological import; 
it implies that the seemingly objective 
task of rating the desirability of a trait 
might provide valid data for assessing 
the personality of the rater. In the 
present study an analysis of judgments 
of the desirability of MMPI items was 
undertaken to ascertain the relative 
number and nature of consistent indi- 
vidual viewpoints of the desirability of 
psychopathological characteristics. A 
sample of 150 college men and women 
rated and later responded to the 566 
items. By examining these desirability 
judgments and the self-descriptive re- 
sponses to the same items it was pos- 
sible to determine the extent to which 
the two response processes reflect com- 
mon personality variance. Of 13 judg- 
mental dimensions which emerged, the 
largest corresponded to the mean 
global desirability rating, and 12 others 
reflected such judgmental points of 
view as: denial of lack of somatic con- 
trol, impulsivity vs. religious preoccu- 
pation, femininity, socially deviant atti- 



tudes, worry, and timid cautiousness 
vs. masculine adventuresomeness. 
Some of the judgmental dimensions 
were highly related to self-reports to 
identical items while other dimensions 
were unrelated to self-report scales de- 
fined by these judgmental dimensions. 
Discussion highlighted the complexity 
of interpreting judgmental viewpoints 
as personality trait measures, and the 
role of defensiveness and other response 
styles as mediators in the two processes. 
The study was done in collaboration 
with D. N. Jackson of the University 
of Western Ontario. USPHS. 

Cognitive Styles and Psychopathology . 
SAMUEL MESSICK 

Over two decades considerable research 
has been directed to identifying certain 
individual differences in the ways we 
organize our perceptions, memory, and 
thinking. These differences have come 
to be known as cognitive styles for 
roughly the same reason that we speak 
of a particular style of writing, or of 
artistic expression as being character- 
istic of one person and not of another. 
Recent studies of the perception and 
cognition of schizophrenics have indi- 
cated these differences may be partic- 
ularly striking between groups of men- 
t nl patients — for example, patients with 
different symptom patterns (paranoid 
versus non paranoid), different levels of 
adequacy in life adjustment prior to 
illness (good versus poor adjustment), 
and different lengths of institutional- 
ization (the acute short-term patient 
versus the chronic long-term patient).. 
Because of the- extent of these dif- 
ferences, a study of mental patient 
responses may clarify many questions 
about cognitive styles in general. Con- 
versely, examining those groups using 
measures different from the customary 
clinical measures may cast new light on 
the nature of thought disorders. To 
these ends an extensive battery of 
perceptual, cognitive, and personality 
measures was given to a sample of 95 
hospitalized schizophrenics. The bat- 
tery included measures of processes of 
interest to cognitive style investigators 
such as field-independence, element 
articulation, form articulation, scan- 
ning, verbal closure, perceptual closure, 
{continued on page 40) 
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This computer print-out reflects some of the com- 
plexities of modern personality research. The com- 
puter is programmed to process research data, to plot 
these data in relation to X and Y axes, and to print 
a diagram of the results. In this instance 600 high 
school students were asked to judge the similarity 
or difference of various emotions. The X and Y axes 
represent two dimensions of perceived similarity — 
pleasantness vs. unpleasantness of the emotion, and 
intensity of the emotion. The various emotions are 
then shown in relation to these two dimensions. The 
significance of the technique is that it will give the 
research psychologist a precise graphic picture of 
many relationships. (See Messick, Cognition of 
Affect.) 
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extremity and confidence of judgment, 
category -width, risk taking, leveling- 
sharpening, conceptual differentiation, 
ideational fluency, and verbal compre- 
hension. Also included -were items of 
case history information, a clinical 
personality inventory, and rating scales 
for symptom expression, properties of 
delusions, and suddenness of onset of 
illness. Analyses are underway to 
isolate consistent patterns of cognitive 
style-personality trait interrelations. 
The study is being done in collabora- 
tion with Drs. Julian Silverman of the 
Agnews State Hospital and Douglas 
Jackson of the University of Western 
Ontario. When completed, the research 
should be of interest to personality re- 
searchers, test developers, and clinical 
psychologists. NICHHD. 

Cognition of Affect. 

SAMUEL MESSICK 

Though thecomplexities of our emotion- 
al life have been explored by legions of 
psychiatrists and psychologists with a 
therapeutic aim, comparatively little 
formal study has been directed to the 
relation of emotion to cognition — or to 
how what we feel influences what we 
know or learn. Among many unanswered 
questions are: How do we perceive and 
evaluate emotions in others and in 
ourselves? How are these views of 
emotion then related to the ways we 
approach and handle intellectual tasks? 
What relation do our views of our 
emotions have to our ideological com- 
mitments (or lack of same)? This study, 
done in collaboration with Dr. Silvan 
Tomkins, was an attempt to answer 
such questions. Measures of cognition 
and personality were given to over 600 
high school students, along with a task 
requiring them to judge the similarities 
and differences among 18 names of so- 
called primary affects, such as fear, 
surprise, joy, and contempt. The result- 
ing data are being analyzed statistically 
to see if characteristic ways of per- 
ceiving emotions can be identified and 
related to individual differences in cog- 
nition and other aspects of personality. 
NIMH and NICHHD. 

Dimensions of Perceived Item Similarity. 

SAMUEL MESSICK 

The study investigated the number and 



nature of dimensions of perceived 
similarity among personality state- 
ments in terms of judged similarities in 
likelihood of endorsement. The dimen- 
sions of judged endorsement frequen- 
cies were in turn related to perceived 
content and desirability consistencies. 
Twenty-three items from the Minne- 
sota Multiphasic Personality Inventory 
were selected to span six dimensions 
found in earlier studies. All possible 
pairs of the 23 items were rated by 150 
college students in terms of the similar- 
ity of each pair of items with respect 
to their probability of endorsement. 
Multidimensional scaling of the re- 
sponses revealed four dimensions of 
viewpoint about item similarity. One 
important distinction appearing in these 
dimensions is the separation of desir- 
able from undesirable item content. 
The study is being done in collabora- 
tion with Douglas Jackson of the Uni- 
versity of Western Ontario. USPHS. 



Learning to Formulate Original 
Responses in Relation to Anxiety 
and Defensiveness. 

NORMAN FREDERIKSEN, 

STEPHEN P. KLEIN, FRANKLIN EVANS 

How does anxiety relate to the produc- 
tion of ideas? One hypothesis is that 
anxiety inhibits the production of ideas 
— that the highly anxious person tends 
to censor his ideas and express only a 
few, whereas the less anxious person 
does not engage in such self-censorship 
and thus expresses more ideas. This 
study explored the issue by using a 
form of programmed instruction that 
provides feedback to the learner in the 
form of ideas others have generated in 
answer to the problems with which he 
is presented. The hypothesis was that 
if people are given a chance to see ideas 
of others that arc considered accept- 
able, this will encourage the highly 
anxious ones not to censor their own 
efforts and to express more ideas. The 
procedure did indeed increase the 
quantity of ideas produced, although 
not their quality. However, contrary to 
the hypothesis, the effect was the same 
for people with both high and low de- 
grees of anxiety. Anxiety was not 
directly related to the quantity of ideas; 
the least anxious people produced the 
greatest number, the highly anxious 



people the next greatest number, and 
people with only medium anxiety the 
least number of ideas. The research 
should be of interest to researchers in 
creativity and will appear in the Journal 
of Educational Psychology. NICHHD. 

Creativity and Environmental Cues in 
Nursery School Children. 

WILLIAM C. WARD 

During recent years there has been a 
surge of research activity on creativity 
within the educational context, but a 
great many open questions still remain. 
This study explored the question of 
what differentiates the creative from 
the uncreative child. Creativity tests 
that required the child to name as many 
ideas as he could that met a simple 
problem requirement were given to 53 
nursery school children. Two of the 
tests were given in a barren room 
typical of experimental studies, and the 
children were divided into creative and 
uncreative groups. The third creativity 
test was then given to part of the group 
under similar cue-poor conditions, but 
to others in a cue-rich testing environ- 
ment — that is, in a room that con- 
tained a variety of stimulating pictures 
and objects. The stimulating room had 
a pronounced effect in encouraging the 
production of ideas by children, but 
with this important difference: While 
the creative children increased their 
ideational production in the stimulating 
setting, the uncreative children did not. 
The conclusion from this research was 
that scanning the environment for 
task-relevant information is an im- 
portant strategy characterizing the 
creative child in his search for solu- 
tions to problems. RB-68-58. Develop- 
mental Psychology , 1969, 1, 543-547. 
NICHHD. 

Rate and Uniqueness in Children's 
Creative Responding. 

WILLIAM C. WARD 

Creativity is commonly viewed as a 
special ability that has been given in 
notable quantities to some but not to 
others. This everyday view has its 
analogue in research among those who 
see differences in creativity from per- 
son to person as lying primarily within 
a range of special cognitive abilities. 
A counter view stresses personality 



and motivational differences — in other 
words, whether we are creative or not 
is seen as depending more on interest 
and drive than on ability, in the narrow 
sense of specific cognitive abilities. To 
put the matter to a test, three ideation- 
al fluency measures were given to 34 
seven- and eight-year-old boys. In keep- 
ing with other studies, it was found 
that over time the children gave fewer 
but better responses, but that creative 
and uncrcativc children differed neither 
in the rate of responses given nor in the 
proportion of unusual responses. The one 
major difference between the two 
groups was that the creative group 
persisted in generating responses, a 
high proportion of which were unique, 
after the uncreative group had stopped 
responding. The findings tend to sup- 
port the view that differences in crea- 
tivity may be more a matter of per- 
sonality and motivation than of basic 
differences in cognitive abilities. The 
research should be of interest to edu- 
cators and research psychologists in- 
terested in creativity. RB-68-36. Child 
Development, 1969, 40, 869-878. NICHHD. 

The Psychology of Response Styles. 

FRED L. DAMARIN, SAMUEL MESSICK 

When people respond to self-report in-, 
struments (personality questionnaires, 
attitude and interest inventories), it is 
usually assumed that they are respond- 
ing to the content of the items and that 
their responses are a function of the 
attitudes, opinions, or personality traits 
the instruments are intended to mea- 
sure. Research, however, has indicated 
thatthere arepervasivegeneral response 
tendencies, or response styles, that affect 
scores obtained on such measures. Ex- 
amples of such styles are the tendency 
to respond to items in terms of their 
perceived social desirability, the ten- 
dency to agree with relatively neutral 
statements regardless of their content, 
and the tendency to use extreme cate- 
gories when responding to rating scales. 
While these response styles have been 
treated chiefly as nuisance variables 
that contaminate tests, the present 
project aims at learning whether they 
can be explained as personality traits. 
A survey was made of correlational and 
factor analytic studies containing re- 
sponse styles measures and objective 







(or performance) measures of per- 
sonality. The review suggested a num- 
ber of ways in which response styles re- 
search may be improved — specifically, 
that current measures of the styles may 
not be optimal, and that there are too 
few conceptually appropriate and 
methodologically sound criterion mea- 
sures of the personality traits supposed- 
ly responsible for stylistic responses. 
More recent work suggests that re- 
sponse styles may be viewed as facets 
of the larger problem of self-descrip- 
tive behavior. A model for predicting 
the emergence of different response 
styles in children at different levels of 
general intelligence has also been 
developed. These studies should be of 
interest to personality researchers and 
all concerned with the validity of self- 
report instruments, and to researchers 
in psychotherapy and forensic psychol- 
ogy. RB-65-10. RB-69-10. NICHHD. 

Leveling -Sharpening as a Cognitive Style. 
FRED L. DAMARIN, VIRGIL MCKENNA, 
SAMUEL MESSICK 

Though leveling-sharpening has gained 
acceptance as a testable personality 
trait, the starting point for this study 
was the question of whether such a 
trait actually exists. In general, leveling- 
sharpening is assumed to be revealed 
in tendencies to minimize (level) or 
maximize (sharpen) differences. A num- 
ber of tests assumed to measure level- 
ing-sharpening were used, among them 
tasks designed to assess the way the 
individual assigns numbers to stimuli 
in psychophysical judgments. It was 
found that there are probably several 
factors (rather than one personality 
trait) that merit the name "leveling- 
sharpening,” but that none of these 
factors or the trait itself is well mea- 
sured at the present time. It was also 
found that individual differences in 
judgment styles do not correlate very 
highly across different sorts of judg- 
ments and stimuli. It was found that 
memory style — for example, a prefer- 
ence for leaving things out versus a 
preference for embellishing memories 
— does show some generality. The 
research should be of interest to re- 
searchers in personality and percep- 
tion. It is related to the general body 
of work on cognitive styles. Memory 



styles findings reported in this study 
may also be relevant to the interests of 
educational researchers. USPHS. 

Study of Objective Tests of 
Personality in Children. 

FRED L. DAMARIN 

An important problem in personality 
research is determining the ways in 
which personality changes, as well as 
remains the same, over a lifetime. One 
difficulty in research of this type is the 
equating of personality tests, so that 
the tests given a child may measure 
comparable traits in an adult. This 
study explored the question of whether 
personality traits identified in an adult 
can also be identified with the same 
sorts of tests in nurseryschool children. 
One general finding was that some 
traits can be identified in both children 
and adults with roughly the same test, 
but it isn’t easy. A problem is that at 
very young ages the scores from per- 
formance tests of personality are very 
likely to be affected by the subject’s 
intellectual level. Technically, thestudy 
is of particular interest in its use of a 
hierarchical factorization approach and 
its study of marker intercovariances in 
groups of different mental ability and 
in the techniques used to interpret 
factors. The work should be of interest 
to personality researchers and develop- 
mental psychologists. One relevance to 
education is the way the study suggests 
that children who succeed in school 
and those who fail may have quite dif- 
ferent alternatives for further person- 
ality development. The study, co- 
authored with Raymond B. Cattell, is 
reported in Monographs of the Society 
for Research in Child Development, 1968, 
33, No. 6, (Serial No. 122). NICHHD. 

Study of Objective Tests of 
Personality in Adults . 

FRED L. DAMARIN 

This study sought to determine whether 
people with character disorders serious 
enough to require special social control 
(imprisonment, for example) differ 
from college students on various fac- 
tors diagnosed by Raymond Cattell’s 
performance tests of personality. It 
found that prisoners and other students 
differ on factors that represent skills 
and habits that are taught in school. 
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However, this could be accounted for 
by the fact that those with character 
disorders were maladjusted in school 
and often dropped out. And other dis- 
cernible differences may have arisen 
from the situational diifcrcnces — that 
is, the eflccts of being imprisoned 
versus the situational effect of being a 
student. The study should be of interest 
to personality researchers, psychia- 
trists, penologists, and those interested 
in new personality test designs. The 
findings may be relevant to education 
in that those with character disorders 
were markedly deficient in many skills 
associated with creativity. This sug- 
gests that the capacity to be creative 
as an adult may depend on exposure to 
schooling, even though it may not de- 
pend on extraordinary school achieve- 
ment. It is also relevant to penology in 
suggesting the need for more research 
on the path'dogical effects of imprison- 
ment. 



Personality Determinants of 
Multiple-Choice Item Preference . 

HENRY ALKER, JULIA CARLSON, 

MARGARET HERMANN 

This study investigated the claim made 
by some critics that multiple-choice 
tests allow the "superficial” person 
adept at test taking to prosper while 
penalizing the "deep” or original 
thinker. A sample of 115 male students 
from a large Eastern university par- 
ticipated. Personality tests were used 
tc classify these students either as 
"superficial” or as "deep” thinkers. 
The students were then given special 
multiple-choice tests developed from 
the verbal section of the College Board 
Scholastic Aptitude Test and English 
Composition Test. Results indicate 
that superficial thinkers actually do 
worse than deep thinkers on multiple- 
choice tests — at least, on the type of 
test used. Being adept at test taking 
tends to help deep thinkers more, 
while being able to recognize am- 
biguity tends to favor superficial think- 
ers. The research should be of interest 
to testing critics and developers. 
NICHHD. Journal of Educational Psy- 
chology, 1969, 60, 231-243. 
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Are Bayesian Optimal Decisions 
A rt ijici a lly Intel l igen t? 

HENRY ALKER, MARGARET HERMANN 

When Bayesian formulas are used to 
predict human behavior, quite fre- 
quently the actual behavior will turn 
out to be more conservative than the 
prediction. This study explored two 
alternative hypotheses as to why this 
happens. The first hypothesis is that 
the Bayesian model is a good simulat ion 
of the information processing of intelli- 
gent, abstractive, rational, nondogmatic 
human beings. However, it is possible 
that a prevalence of unintelligent, 
irrational, dogmatic subjects, with dem- 
onstrated difficulties in processing 
probabilistic information, tend to make 
the human findings more conservative 
than the "clean” Bayesian formulas. 
The second hypothesis was that apply- 
ing Bayesian formulas to complex, im- 
portant human decisions oversimplifies 
the problems, and the apparent con- 
servatism is simply a function of human 
intelligence responding to a recognized 
greater complexity. The experimental 
testing of these hypotheses found sup- 
port for the second, but not for the 
first. That is, it appears the difference 
is not because humans are conserva- 
tive but because Bayesian formulas, as 
simulations of human decision making, 
are inherently risky. The research 
should be of interest to psychologists 
and statisticians interested in Bayesian 
methodology. NICHHD. 



Personality and Test Taking Behavior . 
RAYMOND C. MULRY 

To examine more carefully the rela- 
tionship between test taking time and 
personality and situational variables 
the Mulry Index of Reflective Effort 
(mire) was developed, mire consists of 
"easy” and "difficult” items to which 
responses of agree, disagree, or un- 
decided can be made. The easy items 
are defined as those with which most 
respondents will agree or disagree. 
Difficult items are defined as those to 
which most test takers will respond as 
undecided. High reflective effort is 
inferred when a respondent takes a 
great deal of time ill answering easy 
items. Low reflective effort is inferred 
when respondents take the same amount 




of time in answering difficult items as 
they do in answering easy items. Sev- 
eral studies have been done that deal 
with formal properties of mire. In one 
study, the relationship between prob- 
abilities of endorsement and item la- 
tencies — or the time it takes to respond 
to an item — was examined (RM-67-12). 
In a later study, an attempt was made 
to manipulate latencies on dilficult 
items through the use of a situational 
manipulation. Item latencies were 
found to vary as a function of the prob- 
ability of endorsement and as a func- 
tion of motivational determinants. 
NICIIMD. 

Test Anxiety Study . 

BRUCE BLOXOM 

Factor analytic studies have shown 
that test anxiety is multidimensional — 
that i r j, it lias a variety of causes rather 
than simply being a matter of a so- 
called global anxiety. For example, 
anxiety in test taking may come from 
numerous aspects that arc specific to 
each test situation, such as the test- 
taker’s estimate, in advance of the test, 
of its importance to his final grade, or 
his own estimate of how well he is 
prepared for the test. This study in- 
vestigated a number of such aspects. 
For each aspect, the subjects who re- 
sponded anxiously to it were then com- 
pared with other subjects with respect 
to their scores on conventional test 
anxiety measures and their actual per- 
formance in formal testing situations. 
The subjects were found to respond 
differently in relation to whether they 
felt the test to be important or un- 
important in advance of taking it. On 
the subjectively unimportant tests 
some reported feeling little anxiety and 
performed relatively poorly. Other sub- 
jects felt anxious on both important 
and unimportant tests and performed 
neither better nor worse than the other 
subjects. Of the aspects studied, how 
well prepared a person feels he is before 
taking a test seems to have the greatest 
relation to the amount of tension felt 
during the test. Preparedness also in- 
teracts with a subject’s typical level of 
performance in school and with global 
test anxiety in determining the tension 
felt during test taking. NICHHD. RB- 
68-30. 
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Negotiation Behavior under Conditions 
of Observation and Consultation. 

NATHAN KOCAN 

An important question in exploring the 
nature of negotiation is how leaders’ 
negotiations may be affected by the 
presence of their delegates, and how 
delegates’ negotiations arc affected by 
the presence of their leaders around or 
near the "conference table.” This study 
found that delegates who observe their 
leaders negotiate tend to urge more 
risky courses of action upon the leaders 
than the leaders would be willing to 
accept for themselves. Also, leaders 
who observe their delegates negotiate 
show considerably more agreement 
with their delegates’ decisions than was 
the case when the discussant and ob- 
server roles were reversed. This is quite 
possibly the first study of how negotia- 
tors perform under surveillance, which 
so very often prevails in "real world” 
negotiation settings. A flow chart of 
the complex methodology involved is 
available to researchers. The research 
should be of interest to social psychol- 
ogists, sociologists, political scientists, 
and other social scientists concerned 
w T ith negotiation and conflict resolu- 
tion. ARPA. RB-69-55 (H. Lamm, G. 
TrommsdorfT, co-author). 

Individual and Group Decision Making 
under Conditions of Responsibility 
for Others. 

NATHAN KOGAN 

In virtually all decision-making studies, 
the consequences of the decisions are 
borne only by the decision makers 
themselves. Yet it is common knowl- 
edge that decisions often affect others 
who bad no voice in the decision. This 
study sought to determine whether 
there is any difference between indi- 
viduals and groups in making decisions 
that affect others. It was found that 
individuals are more cautious in mak- 
ing decisions affecting others than they 
are in making decisions that affect only 
themselves. Groups, however, take 
about the same risks whether the 
decisions affect themselves or others. 
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The procedure involved a choice of 
wagers for self and others, with real 
monetary payoffs. Subjects were stu- 
dents at the Sorbonne. The research 
should be of interest to social and ex- 
perimental psychologists with special 
interest in decision making. A note- 
worthy feature is that it links group 
risk-taking studies to research into 
social responsibility and helping be- 
havior. The research seems particularly 
relevant to the problem of promoting 
the welfare of others in complex de- 
cision-making contexts. ARPA. RB-69-9 
(M. Zaleska, co-author) 



Determinants of Risk Taking for Others. 
NATHAN KOGAN, ALLAN TEGEU 

This study is an extension of the ques- 
tion explored in "Individual and Group 
Decision Making under Conditions of 
Responsibility for Others.” Here the 
specific question was: When people 
make decisions for others, what will be 
the effects of friendship and reciprocity 
between the decision maker and the 
person for whom the decision is made? 
That is, what will be the effects of 
whether friendship is present or absent, 
and whether reciprocity (both parties 
having something to gain or lose from 
the action of the other) is present or 
absent? The study found that friend- 
ship had no significant influence on 
decision making in this situation. 
Reciprocity, however, had significant 
effects — subjects were more cautious 
in making decisions that affected others 
when some degree of reciprocity was 
involved. The research was carried out 
at Douglass College, with wagers with 
real monetary payoffs. It should be of 
interest to social and experimental 
psychologists with an interest in deci- 
sion processes. NICHIID. 

Effects of Anticipated Delegate Status 
on Group Risk Taking. 

NATHAN KOGAN 

Will prior knowledge that one is going 
to be a delegate defending a group’s 
interests affect one’s tendency to take 
risks? Exploring this question, this 
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study found that oil the whole antici- 
pated delegate stains neither raises nor 
lowers preferred risk levels in com- 
parison with a control group. However, 
differences were observed between 
delegates who were selected randomly 
and those who were elected by the 
group. The randomly selected delegate 
seemed to have little influence on the 
group’s choice of a risk level. In con- 
trast, the chosen delegate had con- 
siderable influence on the group’s 
choice of risk level, but sometimes of 
a backlash variety — that is, efforts to 
dominate the group can meet with 
rejection of the would-be dominator 
by the group. An aspect of interest is 
that the study was conducted at Nan- 
terre in France shortly before the stu- 
dent riots of May and June 1968. The 
research is reported in Acta Psycho - 
logica, 1969, 29, 228-243, (W. Doise, 
co-author), and should be of interest 
to social psychologists, political scien- 
tists, sociologists, arid all concerned 
with small group behavior. It extends 
the frequent finding of an intragroup 
risky-shift elfect to the case in which 
group members later expect to perform 
as delegates. ARPA. 

Cross-Cultural Study of 
Group Risk Taking. 

JULIA CARLSON 

A curious phenomenon that has in- 
trigued social psychologists during the 
past few years is the "risky-shift.” If 
‘one gives a small group a problem of a 
certain type to discuss and requires 
that they must achieve a consensus on 
its solution, the risky-shift will general- 
ly occur. That is, the members of the 
group will start out with relatively 
conservative or "safe” views on the 
problem’s solution, but group discus- 
sion generally leads to consensus that 
is markedly more venturesome or risky. 
This study was a cross-cultural replica- 
tion of studies by two leading risk- 
taking theorists, Nathan Kogan of ets 
and the New School for Social Research 
and Michael Wallach of Duke Univer- 
sity. One sample Was of 250 Africans, 
and the other sample was of 100 Amer- 
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One pitfall in psychology is the experiment that fails to sufficiently account for 
the complexities of social reality. Another is the experiment that examines only 
a single portion of a process that becomes significant through an interaction 
over time. This diagram shows how both pitfalls are avoided in an experiment 
seeking to reveal the group dynamics of negotiation on conflict-riddcn issues. 
Beyond studying leadership behavior in a single negotiation to consensus, this 
flow chart plots the interaction of leaders, delegates, discussants, and observers 
over three sessions with various possibilities of decisional alternatives. (See 
studies of negotiation behavior, and individual and group decision making by 
Nathan Kogan, under Social Behavior .) 
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ican students. The question being ex- 
plored was whether the risky-shift 
might be, in part, a result of the value 
placed on taking risks as a matter of 
cultural emphasis in America. In sup- 
port of the hypothesis, it was found 
that African subjects were less willing 
to advocate risks in the situations 
presented than the American subjects. 
Though the primary cause of the risky- 
shift still remains unknown, this study 
suggests that the values attached to 
risk taking are important determinants. 
The research should be of interest to 
social psychologists interested in the 
risky-shift, group decision making and 
tolerance for risk, and cross-cultural 
studies. 

Risk Taking in the Context of 
Jn te r group Negoti at ion. 

NATHAN KOGAN 

The problem of negotiating solutions 
to conflicts is a meeting point for psy- 
chologists, political scientists, and in- 
ternational relations experts. Within 
psychology, an important facet of re- 
search has centered on risk-taking 
phenomena — that is, the ways people 
and groups take the various risks that 
are involved in reaching decisions 
acceptable to both parties in a conflict. 
This study sought to find out whether 
the risky-shift effect found within one 
group might also be found in negotia- 
tions between groups. The main finding 
was that the risky-shift effect breaks 
down when negotiators are strongly 
committed to a position on an issue 
which their reference group has taken 
prior to negotiation. However, negotia- 
tors with a minimal commitment to a 
prior position continue to manifest 
risky-shift effects. The study was car- 
ried out at the University of Mann- 
heim, and will be reported in the Jour- 
nal of Experimental Social Psychology 
during 1970 (H. Lamm, co-author). 
The research should be of interest to 
social psychologists, political scientists, 
international relations experts, and 
other social scientists working on con- 
flict resolution. ARPA. 

Pessimism- Optimism and Risk Taking. 
NATHAN KOGAN 

Research has shown that groups tend 
to shift tow r ard more risk taking in a 
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standard experimental situation. Given 
this fact, the question has arisen 
whether there might also be a shift to- 
ward optimism, in the sense of the 
group assigning a higher probability of 
success to the risky alternative. Cogni- 
tive dissonance theory would predict 
such a result. However, this study 
found that, contrary to predictions, the 
groups became progressively more pes- 
simistic in the risk-taking situation. 
Also, the relation between risk and pes- 
simism was found to be asymmetrical. 
That is, risky-shifts are followed by 
pessimistic shifts, but pessimistic shifts 
are not followed by risky-shifts. The 
sample was of German students at the 
University of Mannheim. The research 
is within the risk-taking studies tradi- 
tion and attempts to integrate the 
social psychological work concerned 
with comparing individual and group 
products. It should be of interest to 
social and organizational psychologists, 
and will appear in the Journal of Per- 
sonality and Social Psychology during 
1970. (H. Lamm, G. Trommsdorf, co- 
authors). The results are also impor- 
tant in attempting to generalize risky- 
shift work to the real world in that they 
indicate that pessimism may act as a 
reality brake oil impulsive action by 
groups. ARPA. 



Effects of Representative Status and 
Decision Style on Cooperation 
in the Prisoner s Dilemma. 

NATHAN KOGAN, MARGARET HERMANN 

Over the decade or so since its first 
proposal by Rapoport, the somewhat 
involved "prisoner’s dilemma” situa- 
tion has become the takeoff point for 
research in gamelike behavior and 
decisional processes, much of which 
has been applied to studies simulating 
international conflicts and their pos- 
sible resolutions. Virtually all of the 
work with prisoner’s dilemma, how- 
ever, has involved only one person 
negotiating with another person, where- 
as in real-life conflicts there is generally 
some representation of others involved. 
This study examined the effects of 
individuals compared with teams in the 
dilemma, and also compared the effects 
of teams of friends with teams of 
strangers. Over several trials, it was 



found that individuals are relatively 
uncooperative at the beginning of 
negotiations and become progressively 
more cooperative. Teams of friends, on 
the other hand, are highly cooperative 
at the beginning and remain high. 
Teams of strangers are neither high 
nor low in level of cooperation, but 
begin and remain in-between. The 
study also explored the possibilities of 
pairing "prisoners” according to per- 
sonality similarities and differences, 
and found systematic variations in co- 
operating behavior according to the 
degree to which personalities were 
matched or mismatched. The research 
should be of interest to social and per- 
sonality psychologists and other social 
scientists interested in games and deci- 
sion processes. ARPA. 

Negotiation in Leader and 
Delegate Groups. 

MARGARET HERMANN, NATHAN KOGAN 

From situations of the campus to those 
of world conflict, many hopes have 
come to be centered in the efficacy of 
negotiations and negotiators. Thus, 
conflict resolution is becoming an area 
ofpressingconcern insocial psychology. 
This study explored the question of 
how negotiations carried out by indi- 
viduals with delegated authority differ 
from negotiations carried out by people 
with leadership roles. (A real life ana- 
logue, for example, would be negotia- 
tions by relatively unknown diplomats 
versus negotiations by the Presidents 
of two countries in conflict.) A notable 
finding was that in negotiations leaders 
tend to be more influenced by other 
leaders than are delegates by other 
delegates. Another important finding 
was that negotiating leaders will take 
greater risks than negotiating delegates. 
This came through investigation of 
what is known as risky-shift phenom- 
ena — and the study is one of the first 
to be made of intergroup risky-shift. 
The study is reported in the Journal of 
Conflict Resolution , 1968, 12 , 332-344, 
and should be of interest to social 
psychologists, sociologists, and political 
scientists — as well as anyone in educa- 
tion facing a situation of possible con- 
flict with the necessity for negotiations 
to resolve it. ARPA. 
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Intcrcultural Altitude Study. 

HAROLD GULLIKSEN 

Much as understanding individual dif- 
ferences concerns those interested in 
the advancement of the individual, 
understanding national differences and 
similarities is a concern of those in- 
terested in better international rela- 
tions. A major problem is the assess- 
ment of differences in national atti- 
tudes. This study used advanced statis- 
tical methods to analyze attitude state- 
ments obtained from groups in Norway, 
Sweden, Finland, France, Germany, 
Belgium, and Poland, also Texas and 
Pennsylvania in the United States. 
People were asked for their opinions on 
such enduring human concerns as 
occupational prestige, methods of 
choosing a job, attitudes toward work, 
and aims in. life. In assessing "aims,” 
for example, it was found that "To 
achieve a deep and lasting love” was 
given top ranking by people in Poland, 
Sweden, Italy, and the United States. 
Also "To enjoy good health,” "To 
have a happy home life,"' and "To 
bring up one’s children well” were 
ranked next highest by Swedish, Italian, 
and United States groups. However, 
while many similarities arc present, th* 
study also found differences among the 
groups in the different countries. 
Determining the stability of individual 
and of group judgments is a purpose of 
the study. It should be of interest to 
those concerned with theoretical as- 
pects of scaling and with cross-cultural 
comparisons. 

Pro social Behavior. 

DAVID ROSEN HAN 

Social scientists tend to view altruism 
as either a device to cover actual feel- 
ings of selfishness or hostility, or as 
something pressed into the growing 
child by admonitions to "be good to 
others.” This study examined altruism 
through a series of depth interviews 
with people who risked their lives to 
save others, and with white people who 
were active in the Negro freedom 
movement in 1961. Interviews with 
those active in the freedom movement 
over an extended time indicated that 
they model their behavior after parents 
or other ideal figures who were also 
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notably altruistic and with whom they 
deeply identified. Among those who en- 
gaged in freedom activities over rela- 
tively short periods of time, an in- 
teresting difference came to light. They 
seem to have had parents who preached 
but did not practice altruism and were 
disliked by their children for this 
specific failing. The study is reported 
in two works: Trends and Issues in 
Developmental Psychology (Holt, 
Rinehart & Winston, 1969) and Altru- 
ism and Helping (Academic Press, in 
press). It should be of interest to child 
and experimental social psychologists, 
researchers in higher education, and 
those concerned with social action 
research. 



Observation of 
Prosocial Behavior. 

DAVID ROSENHAN 

The bibles of all religions testify to the 
fact that character development has 
long been a centra! social concern. For 
years it has also concerned some psy- 
chologists, but only recently as a mat- 
ter for consistent, rigorous experi- 
ments. Current interest centers on the 
ways by which good or bad mod els 
(parents, teachers, even television 
heroes) may influence a child’s charac- 
ter development. In a study of how 
altruism is encouraged, two groups of 
children participated in a bowling 
game, one group with an adult model 
present and one group without. Each 
time the model won he received two 
rewards, one of which he contributed 
to a hypothetical charily. Each child 
who won was then observed to see if 
he would, on his own, contribute to 
charily after the model left the room. 
Even though the children were told 
they might contribute, all of those who 
had no model to observe failed to do so. 
Those who did have' a model con- 
tributed — but only if they had already 
donated before the model left the room. 
Later work with this experimental 
situation varied the age and sex of the 
model, the nature of the reward, and 
leaching conditions. HB-66-50; Journal 
of Personality and Social Psychology , 
1967; and Trends and Issues in Develop - 
mental Psychology. NICHHD and NIMH. 
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Cognitive Styles and Altitudinal 
Consistency, 

SAMUEL MESSIC.K 

One of the major areas explored by 
social psychologists during recent years 
is the dynamics of altitudinal consis- 
tency. On the everyday level, this 
consistency is often quite apparent — 
people’s beliefs being linked in often 
very predictable ways with such mat- 
ters as their social status, economic 
level, occupation, political party, race, 
and age. Going beneath the surfaces 
to get at exactly how these consisten- 
cies work involves some very intri- 
cate experimentation and theories, 
but social psychologists have been 
spurred to the effort because of the 
vast range of social phenomena such 
work is beginning to clarify. A great 
deal of recent work, in particular, has 
dealt with the extent to which both 
cognitive and affective components of 
attitude systems jre organized in con- 
sistent patterns, with the operation of 
motivational pressures toward consis- 
tency, and with the specific mechan- 
isms whereby inconsistency is resolved. 
This study is exploring the relation of 
individual diffcj’cnces to attitudinal 
consistency and the generality of such 
operations across different measure- 
ment approaches and response changes. 
A notable methodological aspect of the 
study is that the altitudinal consis- 
tency of a sample of 200 high school 
seniors — who have been extensively 
tested with other measures — is being 
.measured using the experimental pro- 
cedures of four major studies in this 
area: the McGuire Logical Consistency 
Test, the Movrissette Balance Comple- 
tion Test, the Osgood and Tannen- 
baum Congruity Test, and the Rosen- 
berg and Abelson Fenwick Test. The 
study is being done in collaboration 
with J. E. Singer of the State Univer- 
sity of New York at Stony Brook. When 
completed, the research should be of 
interest to social and personality psy- 
chologists working in the area of alti- 
tudinal consistency and cognilivestyles. 
NICHHD. 

Dimensions of Conformity. 

LAWRENCE J, STRICKER, 

SAMUEL MESSICK, DOUGLAS N. JACKSON 

Research into the processes involved in 
(continued on page 51) 




How people of one culture perceive people of other 
cultures is a question of many facets for the mea- 
surement specialist. The national preferences of 
some Texas college students in i960 are shown in 
this chart, as compared with the national prefer- 
ences of students in Chicago in 1928. In both 
years and both localities students rated Americans 
as their first preference among nations (not un- 
surprisingly, the study found that all people sur- 
veyed preferred their own nation first). At the low 



end of the preferences the greatest changes were 
shown in attitudes toward Turks and Russians. 
While rated low r est in national preference by the 
Chicago students in 1928, by 1960 Turks had 
moved to fourth from the lowest in the preferences 
of Texas students. Meanwhile Russians had gone 
from sixth lowest in 1928 to lowest in national 
preferences for Texas students by 1960. 

(See Gulliksen, Intercultural Attitude Study) 
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Measuring the degree to which the attitudes of people of various cultures differ 
from or are alike one another is a pursuit with practical applications to fields 
ranging from education to diplomacy. A questionnaire was given to people in 
Belgium, Italy, France, Germany, and the United States. These charts indicate 
the degree to which Belgian-French and Belgian-Flemish agreed or disagreed 
on goals of life and reasons for work. The charts indicate, for example, that 
while both types of Belgians were in close agreement on "doing God’s will” as 
a goal of life, (point 2, in quadrant II), they greatly disagreed on the importance 
of "self sacrifice for the sake of a better world” as a goal (point 4, quadrant I). 
Likewise, in rating reasons for work they agreed on the importance of good 
working conditions (point 8, quadrant II), while disagreeing to some degree on 
the importance of job security (point 17, quadrant IV). (See Gulliksen, Inter- 
cultural Attitude Study.) 



During recent years the study of conformity has centered upon per- 
fecting models of theoretical relationships, which are based on group 
pressure experiments. The popular view is of conformists and non- 
conformists. This figure, however, shows a "triangle” model proposed 
by Krcch, Crutchfield, and Ballaehey combined with another model 
proposed by Willis. It indicates two kinds of nonconformists — an 
anticonformist, who is actually highly conforming in his rejection 
of pressures to conform; and the independent person, whose behavior 
is relatively unaffected by group influences. (Sec Strieker, Dimensions 
of Conformity.) 
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The above figure is of the Willis "diamond, ” a theoret- 
ical model that adds another interesting component— 
the variable person, who seems to behave independently, 
but actually pursues an erratic personal strategy. The 
figure below depicts the results of an extensive factor 



analysis study by ets psychologists Strieker, Messick, 
and Jackson. This result differs from both previous 
models, but indicates somewhat more support for the 
"triangle” than for the "diamond.” (See Strieker, 
Dimensions of Conformity .) 
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social influence has raised a number of 
important questions. This study ex- 
plored two of these questions. First, 
how arc conforming, anticonforming, 
and independent behaviors inter- 
related? Secondly, to what extent do 
subjects’ suspicions distort tbc results 
in research of this kind? (Standard 
procedures call for a deception wherein 
the subject is misled about both the pur- 
pose of the study and the behavior of 
the other subjects.) This investigation 
found that many subjects correctly 
suspected they were being deceived 
and did not conform; suspicion, in 
effect, invalidated the experimental re- 
sults for these subjects. Contrary to 
most theoretical views, it also found 
that conformity and independence 
seem to represent one bipolar dimen- 
sion, while conformity and anticon- 
formity appear to reflect another bi- 
polar dimension. In addition, the con- 
formity, anticonformity, and independ- 
ence behaviors observed in one ex- 
perimental situation were not highly 
related to the corresponding behavior 
in other situations. This result suggests 
that social influence has rather specific 
effects, depending on the particular 
situation involved. This study is of 
potential interest to researchers in 
personality and social psychology be- 
cause of its unusual methodological 
features. Among its implications arc 
that the use of deception in psycho- 
logical research may be practically, as 
well as ethically, unwise. Various 
phases of this study are reported in the 
Journal of Personality and Social Psy- 
chology (1967, 5, 379-389, and in 
press), and the Journal of Experimental 
Research in Personality (1968, 3, 151- 
167).nichhd. 

Exploratory Research on the 
Escalation of Conflict. 

ALLAN TEGER 

Social psychologists have advanced the 
study of human conflict to the point 
where a body of formal theory on the 



subject is becoming available. Conflict 
theory to date has been concerned 
mainly with the total amount, or the 
presence or absence, of conflict in 
varying circumstances. A theory of 
escalation, or how conflicts grow, has 
been lacking. This exploratory research 
is attempting to develop such a theory 
through a series of laboratory" and field 
studies. Variables being studied include 
the rate of escalation, the value of 
victories, ehanges in the scope of the 
conflict, changes in the images of the 
parties to the conflict, and changes of 
issues as the conflict progresses. One 
field study, for example, was of the 
occupation of a building by radicals on 
the Princeton University campus. So 
far, pilot data indicate that conflicts do 
hot escalate at a uniform rate. Rather, 
the conflict may escalate more rapidly 
immediately after the parties to it pass 
a point of no return, and it may de- 
escalate somewhat when it passes the 
point at which one party had antici- 
pated a victory. Results of the Prince- 
ton building seizure indicate that the 
occupation of a building will reduce 
student support for radical demands, 
while increasing support for building 
occupation as a tactic. The research 
should be of interest to social psy- 
chologists and others studying conflict 
mechanisms. 

Conceptual Complexity and Normative 
Social Expectations. 

ROY E. SHORE 

Research on the development of social 
norms has typically dealt with their 
content, height and strength. (Norm 
components can generally he plotted 
as a curve on a graph, with the curve 
indicating height and strength.) How- 
ever, another important way norms 
probably change in the course of de- 
velopment is in complexity. One ques- 
tion for research concerns the flexi- 
bility of norms. Are they applied dif- 
ferently to different people and situa- 
tions? Are they based on many rather 
than a few considerations? Using a 



theory of conceptual complexity, this 
study attempted to predict the nature 
of a change in the complexity of norms. 
Also using a mens me based on this 
theory, it tried to predict an individuaTs 
normative complexity. One finding was 
that those predicted to have high norm- 
ative complexity did in fact make more 
complex normative judgments. It was 
also found that they tended to base 
their norms on mutual or two-way 
rather than authoritarian, or one-way, 
relationships. A noteworthy aspect of 
the study was the use of a question- 
naire designed to reveal the structure 
of social expectation norms developed 
by Dr. Walter Emmerich of ets. The 
research should be of interest to social 
psychologists and others studying social 
norms and role theory. NICHIID. 

Behavioristic Theory of Attitude 
Development . 

STANLEY M. ZDEP 

Most researchers agree that attitudes 
are learned. This implicates the con- 
cept of reinforcement — or an event 
that strengthens a response in a par- 
ticular situation. However, a single 
reinforcing event can have reward 
value for one person and be seen as 
punishment by another. Additionally, 
there has been considerable contro- 
versy over questions of which attitudes 
are being reinforced in situations of 
some complexity, as well as what deter- 
mines numerous inconsistencies be- 
tween expressed attitudes and observ- 
able behavior. This study reviewed 
existing theory and research data in an 
effort to define (1) how reinforcement 
contributes to attitude formation, and 
(2) what constitutes reinforcement for 
different kinds of individuals. The 
study was theoretical rather than em- 
pirical, and proposes an integrated 
framework for previously diverse ele- 
ments of research and theory. It should 
be of interest to educators interested in 
the formation of negative attitudes to- 
ward school among some groups in 
grades 1-3. 
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Assessment and Development of 
Cognitive Skills in Young Children . 

EDWARD A. CHITTENDEN, GICHAl.D W. 
UKACEY. ANNE M. BUSSIS, MASAKO N. 
TANAKA,. and JEAN If. OltOST 

Known originally as The Ne w )' ork Ci ly 
Project , this venture has developed and 
field-tested new leaching- testing ma- 
icrials in an area of crucial need. The 
project started as an attempt to develop 
assessment methods that would be 
particularly appropriate for urban 
children. As the project progressed, 
emphasis solely on assessment shifted 
to include teaching as well as testing. In 
essence, the child-development theories 
of Jean Piaget have been translated into 
a classroom approach that combines 
teaching with testing in a new way. The 
approach, now ill use in many schools 
throughout the country, was originally 
developed for use with first graders. 
Current work is directed toward pro- 
ducing a set of materials for teachers of 
4- and 5-ycar-old school children. 
Beyond assessment perse , an important 
research emphasis has been to sec to 
what extent the approach can be used 
to encourage cognitive growth. Studies 
of an instructional nature were under- 
taken during 1967-1968 in the areas of 
conservation of number and classifica- 
tion concepts. The project should be of 
interest to teachers and school adminis- 
trators and to researchers in early 
childhood. First grade materials and 
other information on the project arc 
available through the Cooperative 
Tests and Services office of ets. The 
Fund for the Advancement of Educa- 
tion and the Carnegie Corporation have 
been the major funding sources. 
RM-68-13. RB-68-49. 

Preschool Television for Children. 

SAMUEL BALL 

By now the new experimental televi- 
sion show Sesame Street has become a 
welcome fixture in 'many American 
homes. The original idea was to use 
the creative experience and ingenuity 
of commercial television people (artists, 
writers, film makers, etc.) not just to 







sell soap or package "normal” enter- 
tainments, but to see if the same 
methods might be used Lo pipe educa- 
tion directly lo young children in their 
homes. One device, for example, has 
been the use of the one-minute com- 
mercial to inject the ABC’s or number 
concepts into entertaining programs 
offering more indirect learning values. 
From July through December of 1968 
consulting psychologists from ets 
worked with Children’s Television 
Workshop producers to establish be- 
havioral objectives — that is, the spe- 
cific kinds of learning that might best 
prepare preschool children for a good 
school experience. They also worked lo 
develop procedures that would measure 
a child’s progress toward these objec- 
tives* and measure how much the pro- 
gram seemed to be helping. Then on the 
basis of litis experience, from January 
through June of 1969, the ets group 
developed the necessary tests, and in 
July the new television teaching ap- 
proach was given a trial run with 60 
children who were carefully pretested 
and postteslcd. Variables being meas- 
ured included knowledge of letters, 
numbers, forms, body parts and rela- 
tional terms, and skill aL classifying 
and sorting. An approach for inter- 
viewing parents was also developed and 
tried out during this time. The re- 
search should be of interest to pre- 
school educators and researchers in 
educational technology. A report will 
appear during 1970 in Educational 
Television. 

School Readiness Criteria Study. 

SCAR VI A B. ANDERSON 

In both the popular and professional 
literature on early schooling the high 
percentage of "unready” first graders 
has been noted. This has raised the 
question whether our customary first 
grade education is relevant to large 
numbers of first graders. It also under- 
lies the concern of educators for 
achieving the right emphases for Head 
Start in comparison with other pre- 
school and first grade programs. This 
study sought to find out what "school 
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readiness” means to teachers arid 
child development experts, and lo 
determine the relation of teachers’ and 
experts’ readiness criteria to the gen- 
erally stated objectives of preschool 
education. Sonic 7,000 behavioral 
indices (can tic his shoes, can take 
directions, etc.) were collected from a 
national sample of 300 first grade 
teachers. Comparison criteria and ob- 
jectives were developed through panel 
discussions of experts. One finding was 
that teachers arc likely to define "read- 
iness” in cognitive terms but "non- 
rcadincss” in personal-social terms. 
There was also sonic discrepancy be- 
tween teacher and expert expectations 
for beginning first graders and the 
slated objectives of preschool educa- 
tion programs. The research should be 
of interest to educators concerned with 
preschool and elementary programs, 
test makers, and researchers concerned 
with criterion definition. 

SEARCH. 

FREDERICK R. KLING 

Automated instruction for preschool 
children presents both unusual op- 
portunities and unusual problems. 
Young children are curious, eager to 
learn, sometimes even desperate for 
someone to read to them. They also 
have short attention spans, communi- 
cation problems, and minds of their 
own. Finding an effective combination 
of equipment and programing ideas to 
maintain the interest of prereaders 
and to stimulate their learning is the 
goal of project SEARCH (Sequential En- 
richment and Reading for Children). 
Doing this at a practical level, to ob- 
tain some of the advantages of com- 
puterized equipment without com- 
puter costs, lias been a further objec- 
tive. A prototype teaching machine 
and illustrative audiovisual programs 
have been developed. The machine asks 
a question and the child answers by 
selecting a portion of the picture and 
pressing one of three buttons. De- 
pending on the child’s answer, the 
machine then branches onto different 
(continued on page 58) 



Water Level Task 
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An important cognitive skill involves a child’s understanding of relationships 
within our physical surroundings. The "water level task” shows how children 
learn that vertical and horizontal are always in relation to the earth’s surface. 
These actual classroom responses show the range from (a) preoperational, 
through (b) transitional, to (c) concrete operational thinking. (See Chittenden, 
Assessment and Development of Cognitive Skills in Young Children.) 
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Set of Cards for the Sequence Completion Task 
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. Many studies indicate that a child’s awareness of the concept of time undergoes 
■ ;in|tl ie ; earl^iyear s: ^Thus^the^evelopment of the concept of time 

l $$ ^canibe a useful, indicator /of cognitive growth in young children. These are the 

, ;v cards for: -a simple sequence completion task. Given the two cards shown above 

aslced ? t cp m pie t b V t K e; sequence using one of the 
■ 1 ’** ' three" cards- shown f beIo w>tthe line.XSee Chittenden, Assessment and Development 




Sample Items from the Language Comprehension Task 





Dog is swimming 



Dog swam 



Same hats Different hats 



When do children begin to comprehend the small words and inflections that 
govern syntactic structure and logical meaning? These sets of matched pictures 
from the ets Comprehension Task are used in. research designed to 

answer such a question. (See Chittenden, Assessment and Development of Cogni- 
tive Skills in Young Children.) • *. ; - •; 




leaching tracks, thereby individualizing 
the instruction. The immediate re- 
sponse of a human voice to the child’s 
answers appears to be of crucial im- 
portance to the program’s effective- 
ness. The research should be of inter- 
est to teachers and educational technol- 
ogists. 

Literature Appreciation Test , 

Grades 4-6. 

RODERICK IRONSIDE 

To devise a test that would measure 
literature appreciation might, on the 
surface, seem rather easy to do. Some 
who have tackled the task in the past, 
however, have questioned its feasi- 
bility. This project has developed a 
measure that not only will assess sensi- 
tivity to aspects of literature (such as 
literary effects, authors’ devices, and 
styles and meanings) but also will 
measure changes in sensitivity over a 
period of time — an essential capacity 
for an instrument intended to measure 
the effects on students of teaching, 
reading, and other exposures to 'litera- 
ture and life. The completed test, "A 
Look at Literature,” and its handbook 
are now available through Cooperative 
Tests and Services at ets. The lest can 
be used by teachers and researchers to 
assess the effects of various teaching 
approaches on students, to determine 
growth in appreciation over several 
years, or to enhance literature instruc- 
tion itself. The measure is intended for 
group or classroom, rather than indi- 
vidual, comparisons. "A Look at 
Literature” was developed in coopera- 
tion with the Research Foundation of 
the National Council of Teachers of 
English. 



The College Board Candidate Survey. 

ELIZABETH W. HAVEN 

Probably more changes have occurred 
in high school curricula over the past 
10 years than in any previous decade 
in our history. To gain a comprcheu- 
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Church School Curriculum: 

Refidabi l ity an d Usa hi li ty. 

RODERICK IRONSIDE 

In many churches Sunday school 
teaching is a form of amiable chaos at 
best. Fairly recently some large denom- 
inations have tried to improve the situ- 
ation with modernized materials and 
teaching methods. This study sought 
to determine the actual readability and 
usability of some of the new materi- 
als. Over 100 samples of Sunday 
school prose were analyzed in terms of 
various readability formulas. Then 25 
percent of these samples were tested 
with 600 subjects using the relatively 
new cloze method of judging difficulty 
of material in terms of student reading 
behavior and the reactions and test 
answers of students and teachers after 
the material had actually been taught 
in church school settings. Tt was con- 
cluded that much of the material 
studied was too difficult for the grade 
levels for which it was intended. It was 
also found that readability formulas 
alone are not sufficient for establish- 
ing readability and usability of ma- 
terials. The study indicates the neces- 
sity of directly testing the materials 
with readers of the type for whom the 
materials are ostensibly intended. The 
point is of importance as most assess- 
ments of this kind over the past 10 
years have been made with readability 
formulas and relatively little work has 
involved more direct methods — and 
virtually no studies have been made of 
such church-related curricular ma- 
terials. The study should be of interest 
to those concerned with church educa- 
tion, assessing the difficulty and ac- 
ceptability of text materials, or vali- 
dating readability formulas. 



Secondary Education 



sivc picture of what achievement test 
candidates were actually studying by 
the mid-sixties, the College Entrance 
Examination Board supported a survey 
of about 38,000 students who took 
College Board Achievement Tests in 
more than 7,500 high schools through- 



A Study of the Interrelationships Among 
Reading Comprehension Ability , 

IF riling Ability , and the Linguistic 
Structure of the Written Language of 
Sixth- Grade Ch ildren. 

CAROLYN E. MASSAD, JOSEPH P. K END Ell 

There is a new surge of interest in how 
t he four language functions of listen- 
ing, speaking, reading, and writing de- 
velop in children. It is presumed that 
the four abilities are interrelated; how- 
ever, the interrelationship between 
reading and writing has been relatively 
overlooked in research. This study 
sought to find out whether a significant 
relationship exists between the written 
language ability and the reading com- 
prehension ability of sixth-grade pupils. 
One analysis was made of the linguistic 
structure of children’s freely written 
language similar to the analysis used 
by Waller Loban in studying children’s 
oral language. The study found that two 
aspects of the children’s freely written 
language — namely the number of com- 
munication units and the number of 
words per communication unit — arc 
not significantly related to their read- 
ing comprehension ability, nor to 
their ability to use the conventions of 
language to express themselves. Fur- 
ther research on the linguistic struc- 
ture of children’s language as expressed 
in the free essay, for comparison with 
data from objective measures of read- 
ing and writing, should shed more 
light on the problem and provide in- 
formation helpful in developing guide- 
lines for instruction in reading and 
writing. The study should be of interest 
to researchers in psycholinguistics, 
language development, reading, and 
language arts, and to educators. 



out the United States during the 1965- 
66 academic year. Replies were re- 
ceived from 26,000 students. On the 
basis of this high return (70 percent) 
a great deal was learned both of 
changes and what remained unchanged 
in the major subjects being taught in 



American high schools. Test Develop- 
ment Reports written by ets subject 
matter specialists that summarize find- 
ings in the following areas are now 
available from ets at 50 cents per copy: 
Latin (TDU-69-1), Modern Foreign 
Languages (TDK-69-2), Physics (TDK- 
69-3), Mathematics (TDK-69-4), Chem- 
istry (TDK-69-5), Biology (TDK-69-6), 
History and Social Studies (TDK-69-7), 
and English (TDK-69-8). A sample 
finding in social studies was that by 
mid-senior year, despite the stress of 
curricular reformers on the need to 
add or strengthen courses in non- 
western civilizations, 28 percent of the 
students reported no work in history of 
Africa south of the Sahara, and sub- 
stantial percentages said they spent 
less than two weeks on areas such as 
Latin America, Russia, Asia, and North 
Africa. Jn English, contemporary au- 
thors seemed to be gaining in popularity 
^on reading lists — Ogden Nash was as 
widely read as William Blake, and J. D. 
Salinger was as well known as Sir 
Walter Scott or Jane Austen. The 
findings should be of special interest 
to teachers in the above subject areas, 
and to school administrators, curricu- 
lum developers, test specialists, and 
college admissions officers. 

College Board Activity and 
Participa t i on St a t isti as. 

BARBARA PITCHER 

Every year statistics on the numbers 
and abilities of candidates taking the 
Scholastic Aptitude Test (sat) arc com- 
piled for planning purposes. These 
statistics can, for example, be related 
to population figures such as numbers 
of children born a number of years 
earlier, numbers of high school gradu- 
ates, numbers of students enrolled for 
the first time in colleges, and some- 
times important trends arc revealed. 
This study prepared descriptive statis- 
tics on candidates during the 1967-68 
testing year. It found that the number 
of students taking the sat is continu- 
ing to increase, and at a higher rate 
than in the past two years. For ex- 
ample, there was an 8 percent increase 
in the number of SATs administered 
during 1967-68, compared with an in- 
crease of 3 percent during the year 
before, and only 1 percent during the 
year before that. It also found that the 
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increase was greater at the eleventh 
grade than al the twelfth grade level — 
about 18 percent for grade 11 and about 
4 percent for grade 12. The research 
should be of interest to administrators 
and planners in the College Board, to 
KTS administrators, and to planners in 
secondary and higher education. It may 
also he of interest to researchers in 
secondary and higher education and 
test development. CKEB. 

Curricular Appropriateness of the 
College Board Science Achievement 
Tests. 

RAYMOND E. THOMPSON 

One consequence of the relatively rapid 
change in curricula over recent years 
has been the need to fit testing to this 
change. However, where curricular 
change can sometimes he accomplished 
relatively quickly (within a single 
school or system, for example) test 
developers face a problem of another 
sort and magnitude. Offering tests that 
must be standardized and generalized 
to fit the needs of many systems, they 
must include questions relating both 
to "old” as well as "new" curricula, 
and hopefully as many questions as 
possible that arc equally good for both. 
The development of several new 
science courses during the past decade 
has raised the question of how well the 
College Board Science Achievement 
Tests have met this problem. This 
study sought to find out whether the 
tests are equally appropriate for stu- 
dents of both the traditional and the 
newly developed science courses. 
Teachers of both traditional and new 
courses rated the appropriateness of 
test questions. Questions that were 
rated equally appropriate for students 
of both courses were considered to be 
course-free measures of achievement. 
When mean scores on the complete 
tests were adjusted to take account of 
performance on the course-free meas- 
ures of achievement and on the 
Scholastic Aptitude Test, the results 
indicated that recent tests arc indeed 
appropriate for students of botii tradi- 
tional and new courses. The research 
should he of interest to high school 
science teachers, science educators in- 
volved with developing new courses, 
educational researchers, and the gen- 
eral public. CEEB. 



U. S. National Testing in French as a 
Foreign Language. 

JOHN B. CARROLL 

Tests of proficiency in French will he 
given to a large sample of school chil- 
dren in 1971 to compare achievement 
of U.S. students with students in other 
lands, and to find out what influences 
achievement in language by consider- 
ing variations among nations. A final 
revision of the tests has been com- 
pleted, During 1970 and 1971 these 
tesis will he administered as part of the 
International Study of Educational 
Achievement, a project now based in 
Stock holm, Sweden. There have been 
few such international studies of edu- 
cational achievement with tests uni- 
formly given across nations. The final 
results should he of interest to foreign 
language teachers, educational re- 
searchers, and to educators in general. 
The tests relate to those in other sub- 
ject matter areas — in 1967, for ex- 
ample, T. Husen published An Inter- 
national Study of Achievement in Math- 
ematics . Research such as this should 
lead to a better understanding of the 
influences on school learning, particu- 
larly in the learning of foreign lan- 
guages. 

Tests of Cultural Development . 

PAUL B. DIEDERICII 

Above age 13, or the eighth grade level, 
average and below-averagc readers 
report less and less independent read- 
ing, and students who believe that they 
have no talent drop out of music and 
the visual arts. Academic and social 
pressures contribute, hut for what 
other reasons might this break in cul- 
tural development occur at puberty? 
For example, are there particular diffi- 
culties in adult books that discourage 
thc> less capable readers? Tests on 20 
literary works that are most widely 
taught in grades 9-12 are being pre- 
pared for Cooperative Tests and Serv- 
ices at ets. The editing, tryout, and 
statistical analyses of many more ques- 
tions than will be needed in the final 
forms of these tests is making possible 
an exploration in depth of possible 
adult book difficulties. When com- 
pleted, the research should be of inter- 
est to teachers and educational re- 
searchers. 
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Newspaper Tests 

PAUL 13. DIEDERICU 

The American Newspaper Publishers 
Association Foundation sponsors a 
"Newspaper in the Classroom” pro- 
gram that reaches over three million 
students in grades 7 through 12 with 
68 million copies of newspapers every 
year. The Foundation sought ETs’s help 
in developing tests to measure some of 
the effects of this program. Tryout 
forms of tests based on two simulated 
newspapers were given to 4,000 stu- 
dents in 61 schools. Half the students 
were in newspaper classes and the 
other half in control classes of equal 
reading ability but without newspaper 
training. Significant differences were 
fo '.slid between the newspaper and con- 
trol classes, and the types of compe- 
tence revealed by the test items were 
classified into 30 categories that cor- 
respond to most of the objectives of 
newspaper programs. The tests have 
been refined and arc now available 
from Cooperative Tests and Services 
at ets. The research should be of 
interest to teachers of social studies 
and test developers. 

Foreign Language Innovative 
Curriculum Study. 

THOMAS S. BARROWS 

The Foreign Language Innovative Cur- 
riculum Study (flics) is a project to 
develop new ways of teaching and test- 
ing knowledge of foreign languages. 
Educational Testing Service has de- 
veloped tests for two different ap- 
proaches to teaching French humani- 
ties, One approach is the learning 
laboratory met hud, in which in addi- 
tion to his regular classroom work the 
student listens to tape-recorded lessons 
in French in a private cubicle (or carrel, 
as it is known). The other approach is 
team teaching. Teachers from various 
disciplines give lectures relating their 
specialty to French — for example, a 
music teacher will tell of French music, 
a historian of French history, and so 
on. Besides developing tests for both 
approaches, ets provides consultation 
on other phases of evaluation of the 
project, which is being carried out by 
the Ann Arbor, Michigan, Public 
School System with U.S. Office of 
Education Title III support. The study 







should be of interest to teachers of 
foreign languages. 

Brevard County Project. 

DONALD A. TRISMEN 

In the last three years of high school, 
most students find themselves in a 
quandary at the start of each school 
year. In general their question is: What 
choice of classes will give me the best 
grounding and most useful marks in 
relation to some reasonable career or 
college goals? The problem can be ex- 
ceedingly complex and is compounded 
by the feeling that one is locked in 
with one’s choices for the better part 
of a year. Tins project is an experiment 
designed to give tenth- through twelfth- 
year students in an ungraded high 
school in Melbourne, Florida, the in- 
formation they need to plot their own 
courses initially, and also to change 
them as nedecd. At the beginning of 
the ninth year, each student takes an 
, achievement test battery. At the be- 
ginning of the tenth year, the results 
of this testing are used as the basis for 
predicting what he may expect as his 
year-end achievement according to 
various levels of difficulty for each sub- 
ject he wishes to take. The student 
uses these predictions to plot his 
course of study for the year. Then 
every quarter thereafter he is tested 
again and can replot his course. He 
may at this time, for example, advance 
himself a level of difficulty in a subject 
in which he is doing well and wishes to 
explore in greater depth, while drop- 
ping a level in another subject about 
which he may havfs been overconfident. 
This research into the development of 
curriculum-tailored progress tests, and 
combination of discriminant analysis 
and multiple-regression techniques, 
should be of interest to school adminis- 
trators, guidance counselors, and teach- 
ers. USOE. 

Students' Evaluation of the Advanced 
Placement Program and College 
Policy, 

PATRICIA L. CASSERLY 

The College Board’s Advanced Place- 
ment Program (ap) makes it possible 
for secondary school students who ex- 
cel in any of 11 subject areas to take 
college-level w r ork in secondary school. 




Colleges then .may or may not allow AP 
students iaDfiby.pass the usual freshman 
course re«fnired in:their ap subject and 
move onitoraarreadvanced work. Since 
allowing; credit ; is tup to the colleges, 
many have ™*ancfened whether they 
were being too conservative or too 
lenient in their placement of ap stu- 
dents... This research was designed to 
answenthisand other questions through 
irndepth interviews with Advanced 
Placement Program "graduates.” Three 
hundreduand fifty-eight such students 
at -20 highly selective colleges were 
askedrfto 'evaluate their advanced prep- 
aration in secondary school, their 
reception and placement at college, 
and- the effects of this experience on 
their overall college experience, on 
their plans for further education, and 
on their choice of a career. Eighty per- 
cent opthose students who were placed 
ahead by tlie colleges felt that the Ad- 
vanced Placement Program had pre- 
pared them well for work in college. 
These students also won honor grades 
— that is, A’s or B’s in the next sequent 
college course. However, half of the ap 
students interviewed had not been 
granted placement by their colleges, 
and of this group a majority expressed 
frustration and boredom with first- 
year courses. To them these courses 
seemed mainly repeats at a lower level 
of work they had already covered in 
secondary school. One consequence 
w r as that many of these students de- 
clined to take further courses in fields 
they had originally excelled in. The 
research should be of interest to 
teachers and administrators both on 
the college level and in secondary 
schools, and tc administrators of the 
College Board Advanced Placement 
Progra::?. CEEB, RDR-67-68, No. 5, 
RM-68-12. 

The Exeter Alumni Survey. 

RICHARD E. PETERSON, BRUCE K, 
ECKLAND 

Phillips Exeter Academy wanted to 
assess its impact on its students over 
past years in order to plan its future — a 
problem of obvious importance to 
many schools. Two special question- 
naires were developed after many 
interviews and were sent to 13,000 
Exeter alumni and to present students 



and faculty. In addition to gathering 
extensive information on the life his- 
tories of the alumni, the forms asked 
for their feelings, thoughts, doubts, 
and convictions about the Exeter ex- 
perience and its effect upon their lives. 
A comprehensive statistical report was 
made to Exeter. These data may be the 
basis of interpretive studies by the 
school. Among aspects of a more gen- 
eral interest arc what the data may re- 
veal of the strengths and weaknesses of 
the Exeter type of approach — that is, 
the education of an intellectually elite 
group within the situation of maximum 
control of the learning environment. 
Theoretically, the boarding or resi- 
dential school provides such an envir- 
onment in contrast to schools attended 
only a few hours daily while the stu- 
dent lives at home. PR-69-9. Also a 
series of articles in the Exeter alumni 
magazine by Bruce Eckland. 

A Study of Academic Prediction and 
Grotvlh in Grades 5 through 12 . 

THOMAS HILTON, WILLIAM GODWIN, 
CHARLES WE RTS, CATIILEEN PATRICK, 
STEPHEN PENSAK, INCEI30RC STJ EBRITZ 

For a long time educators have felt that 
extensive longitudinal studies might 
eliminate some of the guesswork under- 
lying many areas of American educa- 
tion. Major questions of curriculum, 
teaching methods, and academic predic- 
tion, for example, have seemed to hinge 
on mo re thoroughly researching the 
particular interaction of a child with 
his environment that accounts for in- 
tellectual growth. This project, better 
known as The Growth S'.udy, was 
launched for such a purpose in 1961. 
Thirty-four thousand students ill 173 
U, S. elementary and secondary schools 
were given a battery of tests covering 
a wide range of abilities and requiring 
about 10 hours of testing time. This 
same group of students was then re- 
tested in 1963, 1965, 1967, and finally 
in the spring of 1969. Tests used over 
this eight-year span have included the 
School and College Ability Tests (scat) , 
the Sequential Tests of Educational 
Progress (step), a Test of General 
Information (tgi), College Board 
Achievement Tests in American His- 
tory and English Composition, and the 
Preliminary Scholastic Aptitude Test 
(psat) . The giant resultant "data bank” 



has been used for a number of studies 
reported elsewhere in this and earlier 
summaries of ETS research. 

Growth as a Function of the Amount 
of Training. 

THOMAS L. HILTON, GOSTA W. BERG LUND 

Growth study data were used in this 
project to determine relationships be- 
tween the amount of training in matli 
that a student receives and his actual 
performance. Results of two tests, 
step Mathematics and scat Quantita- 
tive, furnished the trend lines for math 
performance by students within the 
entire Growth Study sample. Tiiese 
results were then compared with the 
amounts of student exposure to math 
courses as reported in the Background 
and Experience Questionnaire (beq). 
With one exception, the net effect was 
as predicted — that amount of training 
is reflected in gains in performance. It 
was also found that this gain is dis- 
cernible as early as the fifth grade. The 
one exception was the failure of the 
group reporting the largest number of 
math courses taken to show the gains 
that might be expected from such an 
exposure. The reason for this may be 
that many students reporting "high 
exposure” are exaggerating. The hypoth- 
esis is being checked. The research 
should be of interest to educational 
researchers. 

PSAT- AIM Norming and 
Follow-Up Study. 

MARTIN R. KATZ, LILA NORRIS 

The Preliminary Scholastic Aptitude 
Test (psat) is widely administered to 
high school students to help them gauge 
their verbal and mathematical abilities. 
The assessment of these abilities is 
often useful in making plans for post- 
secondary education. Norms for the 
psat enable the student to compare his 
own verbal and mathematical abilities 
with those of various reference groups 
— for example, with all the students in 
the same grade throughout the United 
States, or with students who later go on 
to accredited four-year colleges, or 
with students who later go on to two- 
year accredited colleges. This study 
first obtained psat norms for national 
samples of tenth, eleventh, and twelfth 
graders who were tested in the fall of 
1966. The eleventh grade sample was 



followed up through the first year after 
high school graduation, in tiic spring 
of 1969. The Academic Interest Meas- 
ures (aim) were also administered to 
the eleventh graders, along with an 
extensive array of questionnaires. 
Norms for AIM were obtained, and 
studies of its reliability and construct 
validity were conducted. These studies 
suggest that use of aim as a criterion 
instrument may be warranted. Studies 
of its predictive validity arc being com- 
pleted, and analysis of these data should 
indicate whether aim is a useful instru- 
ment for guidance. The research should 
be of interest to guidance counselors, 
curriculum evaluators, and vest de- 
velopment specialists. CEEB. RB-67-39. 
Educational and Psychological Measure- 
ment (27, 1085-1089, 1967). 

Follow-Up Study of a National Sample 
of High School Senior .9, Phase Three. 

BARBARA PITCHER, 

JAMES F. WOHUTUETER 

Continuing research is needed to keep 
the Scholastic Aptitude Test (sat) and 
the Preliminary Scholastic Aptitude 
Test (psat) up-to-date. The purpose of 
this study was to obtain information 
that could be useful in refining norms 
for the tests. In general, it sought to 
find out how the high school psat scores 
of students in the 1960s have related 
to their college performances. Ques- 
tionnaires were used to sample 2,423 
high school students who had taken 
the psat in 1960. One of many findings 
was that at least 62 percent of the col- 
lege entrants (58 percent of the boys 
and 66 percent of the girls) who scored 
in the top five percent of PSAT scores 
for all 1960 high school seniors went 
on to graduate from college within four 
years. The corresponding percentage 
for the top 30 percent who graduate 
was 43, and for those scoring below the 
70th percentile the percent graduated 
Was 25. The study follows an earlier 
study of part of the same group that 
related their psat scores to their records 
as college freshmen. The report should 
be of interest to administrators and 
planners in secondary and higher 'edu- 
cation, high school counselors, college 
admissions and guidance personnel, 
researchers in secondary and higher 
education, and test development spe- 
cialists. SR-68-83. 
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Mean Scale Scores on STEP Reading in Grades 5, 7, 9, and II 



1 Girls Academic 

2 Boys Academic 



3 Girls Nonacademic 

4 Boys Nonacademic 



1 White Academic 

2 Negro Academic 



3 White Nonacademic 

4 Negro Nonacademic 



The ets Growth Study has followed the educational progress of more than 
45,000 students for varying time periods over eight years. These charts illus- 
trate some findings. The curves show, for example, an overall general rise in 
scholastic achievement for boys and girls, and for whiles and blacks, in academic 
and nonacademic curricula, from grades 5 through 11. However, the curves 
also reflect group differences, with the second chart showing the familiar dif- 
ferences between whites and blacks in achievement. Findings of this type have 
been used to support contentions that blacks are genetically deficient in intel- 
lect. The first chart, however, shows the same ordering of differences in achieve- 
ment between boys and girls. As boys are not generally regarded as inherently 
inferior to girls intellectually, the first chart underlines the weakness of theories 
of racial inferiority based on standardized test differences of the type shown in 
the Second chart. (See Hilton, A Study of Academic Prediction and Growth in 
Grades 5 through 12.) 
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Higher Education 



The Scope, of Organized Student Protest 
in 1967-1968 . 

RICHARD E. PETERSON 

By the end of the decade college stu- 
dent unrest had escalated to the point 
where many officials responsible for 
higher education in America considered 
it to be their major problem. This is the 
second of two studies by Dr. Peterson 
on student protest phenomena. It as- 
says student protest during 1967-68 
and then compares these results with 
his earlier study of 1964-65. Question- 
naires were sent to officials of 1,000 
accredited four-year colleges in the 
country. A few findings: During 1967- 
68, issues pertaining to instruction, 
faculty, and freedom of expression 
rarely evoked student activism. Issues 
bearing on personal freedoms and stu- 
dent participation in the governance of 
the college somewhat more often gen- 
erated protest. The Vietnam War was 
the single issue most frequently cited 
by the deans as having triggered stu- 
dent activism. Protest varied according 
to type of institution — draft protests 
took place at 55 percent of the indepen- 
dent universities in contrast to 20 per- 
cent or fewer of the Catholic, teacher- 
training, and technical institutions. 
The largest proportions of student 
bodies were protesting issues involving 
administrative controls over their per- 
sonal lives, while proportions protest- 
ing the draft and war-related recruiters 
were quite small. A comparison of the 
two studies, 1964-65 versus 1967-68, 
w r as particularly interesting. Campuses 
experiencing Vietnam war protesting 
almost doubled during this interval. 
The demand for a larger student role in 
campus governance increased substan- 
tially. Civil rights activism on campuses 
with predominantly w T hite student en- 
rollments declined significantly. Black 
student demands for black history and 
other studies relevant to their new self- 
conception increased. The proportions 
of activists within student bodies did 
not increase, though the number of 
colleges reporting student Left groups 
almost doubled, from 26 percent in 
1965 to 46 percent in 1968. The study 



concludes that while ethical responsi- 
bility remains a crucial issue, the po- 
tential of the student movement for re- 
newing American life "fairly staggers 
the imagination.” The study is avail- 
able from the Institutional Research 
Program for Higher Education. An 
abridged version appeared in Foster 
and Long (Eds.). Protest! Student Activ- 
ism in America . Morrow, 1969. 

Conversations Toward a Definition of 
Institu t ion al Vitality. 

RICHARD E. PETERSON, DAVID E. LOYE 

Many pressures today arc placing col- 
leges and universities in a new position 
of social accountability. If a college is 
to serve its society, it would seem it 
must in some sense be "vital/’ But how 
is one to define "institutional vitality”? 
And once some conception of institu- 
tional vitality is developed, can a satis- 
factory instrument be constructed to 
assess colleges and universities against 
such a criterion? These questions were 
explored during the early research 
on the new Institutional Functioning 
Inventory: To tap a wide range of 
opinions, a queslioimaire was sent to 
1,305 people in higher education across 
the country. Then to explore the ques- 
tions in greater depth two panels of 
experts were gathered at ets for exten- 
sive discussions, which were tape re- 
corded and edited for analysis. Botli 
survey results and the edited discus- 
sions have been published in Conversa- 
tions Toward a Definition of Institutional 
Vitality , available from the Institution- 
al Research Program for Higher Edu- 
cation at ETS. In addition to ets staff 
experts, discussants included Morris 
Keeton, Vice President of Antioch Col- 
lege, Warren Bryan Martin of the 
Center for Research and Development 
in Higher Education in Berkeley, Otis 
Singletary, Vice President, American 
Council on Education, Earl McGrath, 
JB Lon Heflerlin and Hans Flexner of 
the Columbia University Institute of 
Higher Education, and sociologists 
Harold and Pauline Pepinsky of Ohio 
State University. The research should 
be of interest to trustees, administra- 
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tors, researchers, and foundations offi- 
cials concerned with higher education. 
Kettering Foundation. 

Institutional Vitality Study . 

RICHARD E. PETERSON, RODNEY T. 
HARTNETT, JOHN A. CENTRA 

What makes some colleges and uni- 
versities grow and contribute in major 
ways to the individual and to society? 
Why do others merely hold their own 
or even go downhill? What, too, might 
account for peaks as well as slumps in 
significance for a college over the long 
stretch of time? To answer such ques- 
tions, and to develop a practical means 
of measuring whatever may constitute 
"vital ity” in an institution, this proj- 
ect was launched in 1967 in coopera- 
tion with the Institute of Higher Edu- 
cation of Teachers College, Columbia 
University, with funding from the Ket- 
tering Foundation. An extensive survey 
was made to find out what "institution- 
al vitality” means to people who arc 
concerned with the totality of a college 
or university — presidents, deans, stu- 
dent editors, writers. Conferences with 
experts, to probe the problems of what 
should be measured and how, were 
also held. Out of this experience a new 
instrument called The Institutional 
Functioning inventory was developed. 
It has been extensively pretested and 
is now available with a preliminary 
technical manual from the Institution- 
al Research Program for Higher Edu- 
cation at ETS. 

Trustee Study. 

RODNEY T. HARTNETT 

The traditional role of the trustee as 
the one who is ultimately responsible 
for charting the course of his college 
is being widely challenged. As crisis 
after crisis erupts on the American 
college campus, the trustee is often 
caught in the middle with both faculty 
and students demanding a greater 
share in the governing of colleges and 
universities, and being a more remote 
figure he is usually seen in terms of 
negative stereotypes. This study 
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sought to go beneath the stereotype 
and find out who the trustees really 
are, what they do in their roles as 
trustees, and how they feel about cur- 
rent issues and problems in American 
higher education. A questionnaire was 
mailed to a national sample of over 
9,000 trustees. One of many findings 
was that trustees are generally some- 
what cautious regarding the notion of 
academic freedom — generally they pre- 
fer to exclude even members of the 
faculty from decisions having to do 
with the academic program of the in- 
stitution. In these and other areas, the 
attitudes of trustees differed markedly 
from those of the faculty. However, the 
study also showed in considerable de- 
tail that it is naive to speak of the 
"college trustee” as being any one type 
of person. It found a great deal of 
diversity between and among trustees 
serving on the boards of different types 
of institutions. The research should he 
of general interest to educators, par- 
ticularly college administrators and 
faculty members. It has been published 
by ETS under the title College and Uni- 
versity Trustees: Their Backgrounds , 

Roles, and Educational Attitudes (1969). 

The Trustee in North Carolina. . 

JUNIUS A. DAVIS 

In the spring of 1968 some 1,600 trus- 
tees of colleges and universities in 
North Carolina were sent a question- 
naire. The questions dealt with who 
the trustees are, the nature of their 
service to their college or university, 
and where they stood on a number of 
crucial, current issues facing higher 
education. From the responses of 800 
a number of interesting findings 
emerged. For example, 88 percent of 
the responding trustees were male. 
Only 7 percent were below the age of 
40. Practically all trustees for tradi- 
tionally white institutions were white, 
while for traditionally black institu- 
tions only half were black. Trustees 
were overwhelmingly Protestant, only 
3 percent being Catholics or Jews. Their 
median annual income was §25,000. 
In public institutions about one-half 
and in private institutions about one- 
third were business executives. About 
90 percent of the trustees of the public 
institutions reported they were Demo- 
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crats; however, their preferences 
among Presidential candidates at the 
time of the survey were Richard Nixon 
first, Nelson Rockefeller second, then 
Eugene McCarthy, Lyndon Johnson, 
and Ronald Reagan. The majority — 80 
percent — were serving on a college or 
university trustee board for the first 
time. Only 7 percent felt faculty mem- 
bers should be involved in the selec-* 
tion of a college president. Two-thirds 
felt loyalty oaths for professors were 
reasonable. More than three-fourths 
favored official screening of campus 
speakers and almost half favored ad- 
ministrator control of the content of 
student newspapers. The research 
should be of interest to psychologists 
and sociologists researching higher 
education, and to others concerned 
with college governance. 



Agreement with Views of 
Martin. Luther King, Jr., 

Before and After His Assassination. 

RODNEY T. HARTNETT, 

CAROL U. LIBBY 

Prior to the assassination of Dr. Martin 
Luther King, the trustees of a number 
of American colleges and universities 
had received a lengthy questionnaire 
covering attitudes on many issues in 
connection with the College Trustee 
Study. The fact that a sizable number 
of the questionnaires were returned be- 
fore and ii sizable number after Dr. 
King’s death suggested the possibility 
that this socially traumatic event might 
be reflected in a change in question- 
naire responses. Comparison of the 
questionnaire data showed that there 
had, indeed, been a pronounced ap- 
parent change in the political and social 
views of this group. Whereas before Dr. 
King’s death, many trustees expressed 
attitudes at variance with King’s, ques- 
tionnaires . received after his death 
showed a liberalized attitudinal change 
in the direction of Dr. King’s views. 
Significantly, this change in attitudes 
occurred more often among Republi- 
cans than among Democrats, and more 
often among conservatives than lib- 
erals — Democrats and liberals, it was 
assumed, being closer to Dr. King’s 
views originally. The research should 
be of interest to psychologists, sociolo- 
gists, political scientists, and other 




social and behavioral scientists. The 
findings are in keeping with certain 
events and group behawornl patterns 
folio wing President Kennedy s assas- 
sination. IUJ-68-35. 

Academic Growth in Predominantly 
Negro and Predominantly White 
Colleges . 

JOHN A. CENTRA, ROBERT L. LINN, 

MARY ELLEN PARRY 

Some critics feel the value of an educa- 
tion at most Negro colleges is slight, 
fn this study seven predominantly 
while colleges were matched with seven 
predominantly Negro colleges accord- 
ing to purposes, type of control, and 
ability level of students. Then the two 
groups were compared in terms of the 
scores of students who had taken the 
Area Tests of the Graduate Record 
Examinations Institutional Testing 
Program as college seniors and the 
Scholastic Aptitude Test as entering 
freshmen. The purpose was to see 
whether under these circumstances 
one group of colleges would show 
more academic improvement of its 
students than the other. No significant 
differences were found between the 
two groups of colleges in ore Area Test 
scores in Social Science or Natural 
Science when using SAT scores as co- 
variates. Moreover, inspection of re- 
gression lines for the data from the 
colleges also supported the conclusion 
that neither group of colleges was any 
more or less effective in encouraging 
academic growth. The research should 
be of interest to faculty and adminis- 
trators in higher education, agencies 
interested in Negro education, and re- 
searchers in higher education. A report 
appeared in the January, 1970 issue of 
the American Educational Research 
Journal . RB-69-39. 

Differences in Selected Attitudes and 
College Orientations Between Black 
Students Attending Traditionally Negro 
and Traditionally White Institutions. 
RODNEY T. HARTNETT 

Over the past few years many predom- 
inantly white colleges and universities 
have been going out of their way to 
search for qualified Negro students. 
However, this practice is viewed with 
mixed feelings by some observers 



IFI SCALES 



1. Intellectual-Aesthetic Extracurriculum (IAE) : the extent to which 

activities and opportunities for intellectual and aesthetic stimu- 
lation are available outside the classroom. 

2. Freedom (F) the extent of academic freedom for faculty and students 
as well as freedom in their personal lives for all individuals in the 
campus community* 

3. Human Diversity (HD): the degree to which the faculty and student 

body are heterogeneous in their backgrounds and present attitudes. 

4. Concern for Improvement of Society (IS): the desire among people 

at the institution to apply their knowledge and skills in solving 
social problems and prompting social change in America* 

5. Concern for Undergraduate Learning (UL) : the degree to which the 

college — in its structure, function, and professional commitment 
of faculty — emphasizes undergraduate teaching and learning. 

6. Democratic Governance (DG) : the extent to which individuals in 

the campus community who are directly affected by a decision have 
the opportunity to participate in making the decision. 

7. Meeting Local Needs (MLN) : institutional emphasis on providing 

educational and cultural opportunities for all adults in the sur- 
rounding communities. 

8. Self-Study and Planning (SP) : the importance college leaders 

attach to continuous long-range planning for the total institution, 
and to institutional research needed in formulating and revising 
plans . 

9. Concern for Advancing Knowledge (AK) : the degree to which the 

institution — in its structure, function, and professional commit- 
ment of faculty— emphasizes research and scholarship aimed at 
extending the scope of human knowledge. 

10. Concern for Innovation (Cl) : the strength of institutional com- 

mitment to experimentation with new ideas for educational practice. 

11. Institutional Esprit (IE): the level of morale and sense of shared 

purposes among faculty and administrators. 



A relatively new instrument, The Institutional Functioning Invento>.y (ifi), 
has been developed by the ets Higher Education Group to aid colleges and 
universities in the difficult task of self-assessment. A standard questionnaire is 
given to faculty, administration, in part to students, or to any other group 
whose rating of the institution is desired. Extensive research established that 
these 11 dimensions are the most relevant for rating purposes. (See Peterson, 
Institutional Vitality Study.) 
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PERCENTILE RANKS 



INSTITUTIONAL MEANS 




The possibilities of the Institutional Functioning Inventory (ifi) are perhaps 
most quickly evidenced by the clear and carefully quantified profiles the in- 
strument makes possible. Means for responses to questions relating to each of 
the 11 institutional dimensions are plotted on a standard grid. Shown here are 
the contrasting profiles of two college.* based on the perceptions of each insti- 
tution by its faculty. The profiles are of an armed-services academy (solid line) 
and a selective liberal arts college (dotted line). (See Peterson, Institutional 
Vitality Study.) 



o 

ERiC 



who arc concerned that .siphoning off 
talented black students will hurt the 
quality of the Negro schools. The pur- 
pose of this study was to see what edu- 
cationally relevant differ cnees exist, 
if any, between two groups of black 
collegians — those who enter tradition- 
ally Negro colleges and those who 
enter integrated colleges. College Stu- 
dent Questionnaires, Part T dal a were 
obtained from 3,104 students at 9 
traditionally Negro colleges and 323 
students at 21 integrated colleges. In 
addition, data on scores from the verbal 
sections of the Scholastic Aptitude 
Test (sat) were obtained for a sample 
of each of these groups. Perhaps the 
most notable single finding was that 
black students entering integrated 
schools were found to have higher 
SAT-v scores, to be more independent, 
more liberal, more concerned with 
social injustice, and to aspire to more 
years of formal education. Many alti- 
tudinal differences between the two 
groups were also found to be highly 
correlated with SAT-V scores. The re- 
search should be of interest to re- 
searchers in higher education, and to 
those concerned with the aspirations 
of the black collegian. RB-69-48. 

Development of the Questionnaire on 
Student and College Characteristics . 

JOHN A. CENTRA 

Both colleges and students seeking to 
enter them have a problem in common. 
Underneath the mountain of words and 
pictures directed to presenting the col- 
lege in catalogues and little booklets, 
both colleges and students seek to grasp 
what the college is really like. This 
study developed the Questionnaire on 
Student and College Characteristics 
(qscc) for simplifying the process. 
Using upperclassmen as respondents, 
the questionnaire gathers three types 
of information about a specific college 



— student perceptions of the college 
and its learning environment, student 
behavior patterns, and student charac- 
teristics, such as religious and ethnic 
mix, or interest patterns. The instru- 
ment was pretested at eight colleges, 
revised, and then administered at over 
200 institutions in the fall of 1968. In- 
formation from the QSCC may he used 
by .colleges to describe themselves in 
The College Handbook. Currently re- 
search is under way to identify dimen- 
sions that will describe meaningful dif- 
ferences among colleges: eventually 
the results will he related to college 
environment studies, 'flic finished in- 
strument and the research related to 
differences among colleges should be 
of interest to high school guidance 
counselors, college admissions officers, 
prospective college students, and re- 
searchers in higher education. CEEB. 
RM-68-11. 

College Fresh man A 1 1 i til d cs 
T o i va rd, Ch eat lag . 

JOHN a. centra 

This study sought answers to two ques- 
tions: (1) what are the characteristics 
of students with lenient attitudes to- 
ward cheating, and (2) do attitudes to- 
ward cheating vary according to dif- 
ferent types of schools? The student 
sample consisted of 1,500 entering 
freshmen at 37 colleges, the institu- 
tional sample of 119 colleges and uni- 
versities. It was found that students 
with lenient attitudes toward academic 
cheating shared similar attitudes about 
cheating in government and industry. 
The cheating-lenient student also tend- 
ed to be less academically motivated, 
to have fewer artistic-literary interests, 
and to come from a lower socioeco- 
nomic background than the cheating- 
strict student. As for school differences, 
it was found that students at institu- 
tions that were fairly selective, had all- 
female enrollments, and were small in 



size had the strongest altitudes against 
cheating. The study suggests that the 
kind of student who enrolls in an insti- 
tution is an important determinant of 
the peer climate, which, in turn, sets 
the school's characteristic altitudinal 
climate toward cheating. The study, 
which was reported in the January, 
1970, issue of the Personal and Guid- 
ance Journal, should he of interest to 
counselors in colleges and to research- 
ers in higher education. KH-69-24. 



A 1 1 it u des and Secon da ry Sch ool 
Backgrounds of Catholics Entering 
College. 

RODNEY T. HARTNETT, JOHN A. CENTRA 

Recent research lias indicated that a 
cumulative Catholic education — that 
is, consistently attending Catholic 
schools over a number of years — 
produces adults who are not only more 
religious than customary but whose 
altitudes also reflect more social con- 
cern. This study used the College 
Student Questionnaires, Part T, to 
obtain data for comparing the back- 
grounds and attitudes of 1,700 men 
enrolled at six Catholic and seven no 11 - 
Catholic colleges. The most notable 
finding w’as that students who chose 
the Catholic colleges reflected more 
social concern than those who chose 
the non-Catholic colleges. This sug- 
gests that the finding of more social 
concern is not necessarily the result 
of the cumulative effect of attending 
Catholic primary and secondary schools 
and colleges, but could be the result of 
a choice influenced by the nature of 
Catholic colleges. The research should 
be of interest to Catholic college admin- 
istrators and researchers in higher edu- 
cation. It questions some of the con- 
clusions reached by Grcely and Russi 
in The Education of American Catholics. 
A report appeared in Sociology of Edu- 
cation Spring, 1969. RB-68-24. 
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Graduate and Professional Education 



Investigation of Graduate Admission 
Policies and Procedures . 

RICHARD L. BURNS 

Like all oilier aspects of education, 
graduate schools arc undergoing con- 
siderable pressure for change. The pur- 
pose of this project is to gather informa- 
tion on graduate admissions policies, 
procedures, and trends in every grad- 
uate school in the country, and then 
to make the results widely known. The 
information will be used (1) to aid the 
Graduate Record Examinations Board 
and UTS in planning programs and other 
activities in graduate admissions; (2) 
to make available to all graduate schools 
up-to-date information on procedures 
and policies being followed by other 
schools throughout the country; and 
(3) to stimulate thinking in the grad- 
uate schools about admissions proce- 
dures and policy improvements, Dur- 
ing Phase I a survey will be made of all 
graduate schools. Phase II will involve 
visits to a limited number of graduate 
schools to develop case studies of ad- 
missions policies and procedures. When 
completed, the research should be of 
interest to administrators and graduate 
school admissions personnel. CUE 
Board. 



GRE Creativity Project. 

JONATHAN Ft. WARREN 

In various ways graduate schools seek 
to identify creative students who may 
go beyond the traditional learning in 
any field to enlarge or improve it. It is, 
however, much easier to understand 
creativity informally than it is to meas- 
ure it formally with standardized in- 
struments. The purpose of this project 
is to explore the measurement of 
creativity at the graduate level by first 
defining creativity as a matter of pro- 
ductivity, originality, and independent 
thinking, and then attempting to iden- 
tify it in students by interrelating 
various measures to the Graduate 
Record Examinations. Measures being 
evaluated include a biographical inven- 
tory, and a revised Independent Activ- 
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ities Questionnaire, which is a relative- 
ly recent standardized measure of some 
aspects of creativity developed by ets. 
Criteria include peer ratings of the de- 
gree to which a fellow graduate student 
seems creative, graduate school grades, 
and situational tasks that require sonic 
degree of creativity in their resolution. 
Data have been collected on students 
in electrical engineering, psychology, 
and English at five graduate schools in 
each field. When completed, the re- 
search should be of interest to grad- 
uate admissions personnel, test de- 
velopers, and psychologists working in 
the area of creativity. GRE Board. 



Alternative Methods of GRE Advanced 
Tests. 

.1. GARY LUTZ, SUSAN F. FORD 

An important problem in test develop- 
ment is the equating of tests across 
forms. That is, most tests must be 
changed from administration to ad- 
ministration. But each new form, 
though changed and containing fresh 
items, must still measure the same 
abilities and also maintain the same 
overall proportion of level of difficulty. 
Equating, therefore, becomes quite a 
complex problem. The purpose of this 
study is to see whether what is known 
as common-item equating of the Grad- 
uate Record Examinations (gre) Ad- 
vanced Tests is superior to a method 
using the verbal and quantitative sec- 
tions of the gre Aptitude Test. The 
study is designed to answer three ques- 
tions: one, does equating through apti- 
tude tests, in general, yield significantly 
different results from those yielded by 
common-item equaLing? Two, does 
stability of equating through the apti- 
tude tests compare to that of common- 
item equating across various adminis- 
tration months? And three, how does 
the stability of equating through apti- 
tude tests compare to common-item 
equating across various educational 
levels of candidates? When completed, 
the research should be of interest To 
test developers. GRE Board. / 




GRE Cooperative Study of Predicting 
Graduate School Success. 

GERALD V. L ANNUO LM, WILLIAM B. 
SCHRADER, GARY L. MARCO 

This study explored possible methods 
for increasing the predictive validity of 
the Graduate Record Examinations 
(gre) Aptitude and Advanced Tests. 
Undergraduate grades for a number of 
doctoral candidates were obtained and 
also ratings by professors of their cur- 
rent excellence, achievement, and 
promise in graduate school. The six 
academic fields studied were chemistry, 
physics, English, philosophy, history, 
and psychology. It was found that un- 
dergraduate grade-point average (gpa), 
which was available for 12 groups, was 
a reasonably good predictor in four of 
these groups, but a poor predictor in 
five groups. When undergraduate GPA 
was combined with GRE test scores 
using judgmentaliy determined weights, 
the weighted total yielded better predic- 
tion than undergraduate gpa alone in 
all 12 groups, (with a gain of .14 or 
more in six of the groups). The results 
offer some support for the use of a 
priori weighting — or placing more value 
on some test results than on others — in 
combining predictors. The research 
should be of interest to graduate admis- 
sions personnel. GRE SR-68-3. 

The Use of GRE Scores and Other Factors 
in Graduate School Admissions. 

GERALD V. LANNHOLM 

This study was undertaken to gain in- 
formation about the use of Graduate 
Record Examinations (gre) scores and 
other factors in admitting practices 
for graduate schools. Departments in 
30 universities were sent question- 
naires. The results of the survey indi- 
cated that all respondents collected 
more than one type of information 
about applicants. Approximately 40 
percent had established formal admis- 
sions standards in terms of minimum 
GRE scores required. However, only a 
relatively small percent (6.6) used test 
scores as the principal factor in admis- 
sions decisions, with a range of mini- 



mum scores from 450 to 750 for verbal 
ability, and 450 to 700 for quantitative 
ability. Most gave the highest ranking 
to the undergraduate record. While 
total agreement on the value of letters 
of recommendation wasn’t found, 33 
percent indicated that they would never 
admit applicants with high gre scores 
but poor letters. However, 74 percent 
reported that they would sometimes 
admit applicants with low gre scores 
but good letters. GRE SR-68-4, October, 
1968. 

Validity of GRE Advanced Tests for 
Predicting Law School Success. 

WILLIAM B. SCHRADER, 

BARBARA PITCHER 

The purpose of this study was to deter- 
mine whether the Advanced Tests of 
the Graduate Record Examinations 
(ore) will improve prediction of law 
school grades when used along with 
the Law School Admission Test {lsat) 
and undergraduate grade averages. 
It is plausible, for example, that 
an undergraduate who performs v r ell 
on tests in his major field will be a 
better law school student than Gne 
whose gre Advanced Teat performance 
is mediocre or poor. Advanced Tests 
were given to about 900 students in six 
law schools in the fall of 1966., Their 
first-year law school grade averages 
were also obtained and validity coeffi- 
cients computed for each law school. 
Preliminary findings indicate that gre 
scores do not add appreciably to law 
school grade prediction over use of the 
LSAT and undergraduate average or 
grades alone. However, gre scores do 
correlate moderately with law school 
grades in the relatively homogeneous 
groups that were studied. LSAT Council. 

Continuation of Criterion Study: LSAT 
ROBERT L. LINN 

This study sought to find out to what 
extent grades assigned by law T profes- 
sors to students’ essays are dependent 
upon the content of a student’s answers, 
the way he approaches the problem, 
and certain extraneous factors, such as 
the number of words or the number of 
polysyllabic "words he uses. Although 
initial results indicated that essay 
grades were quite predictable from 



simple essay length, a more refined 
analysis indicates that it is only the 
number of words that are expended on 
issues judged to be of a major impor- 
tance that accounts for this predictabil- 
ity. Sponsored by the Law School 
Admissions Test Board, this research 
should be of interest to law f schools and 
to any other group interested in essay 
tests. It provides a better understand- 
ing of the factors influencing the assign- 
ment of grades in essay examinations 
and relates to a large body of research 
on the reliability and validity of essay 
tests. LSAT Board. 

Interpreting Performance of Foreign 
Law Students on LSAT and the Test 
of English as a Foreign Language. 
[TOEFL) 

WILLIAM B. SCHRALER 

The purpose of this study was to in- 
vestigate two questions: How effective 
are lsat and toefl scores in predicting 
language effectiveness and academic 
performance of foreign law students? 
And to what extent do foreign students 
show marked improvement in per- 
formance on the tests as the result of a 
relatively brief orientation program 
■which includes special instruction in 
English for some students? The LSAT 
and toefl were given at the beginning 
and end of an eight-week intensive 
orientation program during the sum- 
mer of 1968. Additional data are being 
gathered for analysis. LSAT Council, 
Orientation Program in American Law, 
and CEEB. 

Factor Analysis of the LSAT. 

ALFRED B. CARLSON 

The purpose of this study was to gain a 
better understanding of the abilities 
measured by the Law School Admis- 
sion Test (lsat). Specifically, the 
questions were: What abilities are cur- 
rent lsat items measuring? And are the 
abilities measured by the afternoon 
tests (Writing Ability and General 
Background) different from those meas- 
ured by the morning test? Seven fac- 
tors were identified in the morning 
lsat: reading comprehension, figure 
classification, tabular data interpreta- 
tion, graphical data interpretation, 
numerical recall, verbal inductive 
reasoning, and a seventh uninterpreted 



factor. Conclusions drawn on the basis 
of the findings of the study should be 
of interest to test developers. LSAT 
Council. 

Summary of LSAT Research. 

ROBERTA B. FLESHER 

Over the past 20 years, numerous re- 
search studies of various questions 
relevant to the development or im- 
provement of the Law School Admis* 
sion Test (lsat) have been carried out. 
This project summarizes 27 of these 
studies, and should be of interest to 
law school admissions officers, new 
LSAT Committee members, educators, 
and psychologists. LSAT Council. 

Special Item Analysis of the Admission 
Test, for Graduate Study in Business 
for Candidates Sponsored by the 
Consortium for Graduate Study in 
Business for Negroes. 

WILLIAM R. COWELL 

The Consortium for Graduate Study in 
Business for Negroes was formed in 
1966 to encourage Negro undergrad- 
uates aiming teward a business career 
tc enter graduate schools of business. 
The purpose of this study was to gain a 
better understanding of the general 
nature of candidates being selected by 
the Consortium in comparison with 
non-Consortium candidates. Admis- 
sion Test for Graduate Study in Busi- 
ness responses for the two groups 
were compared bn an item-by-item 
as well as total-score basis. It was 
found that the two groups differed 
significantly on verbal and quantitative 
scores, the Consortium group scoring 
higher than the non-Consortium group 
on verbal. Significant differences were 
found on 12 of 90 verbal items and 14 
of 75 quantitative items, there being 
generally a remarkable similarity in 
the distribution of wrong responses 
among the options. Among quantita- 
tive items, those involving percentages 
were - found to be significantly more 
difficult for the Consortium group. The 
test was found to be about equally re- 
liable for bolh groups. The research 
should be of interest to graduate busi- 
ness school admissions personnel, re- 
searchers in higher education, and 
educators concerned with social action. 
ATGSB. 
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ATGSB Grade Grouping Study. 

ROBERT F, BOLDT 

Among those concerned with the ad- 
missions problems of graduate schools 
of business, there is widespread dis- 
satisfaction with grade-point average 
(gpa) as an indicator of academic per- 
formance. One aspect of this dissatis- 
faction is that the grade-point average 
is a conglomerate, which, by averaging 
grades, levels off strengths ou one 
hand and on the other hand masks 
weaknesses. The purpose of this study is 
to determine, on a pilot basis, whether 
there is some reductive alternative 
other than the single GPA score. For ex- 
ample, can a few general abilities of 
potential importance for comparison 
purposes be discerned underlying 
groups of courses? If such a relation- 
ship of underlying abilities to group- 
ings of courses could be discerned, it 
might provide a more adequate means 
of interpreting grades and test scores. 
This study is exploring such questions 
factor-analytically with data from the 
graduating classes of two graduate 
schools of business. To date, analysis 
of data from the schools yields a single 
factor that correlates highly with 
grades in mathematics and quantitative 
studies generally and with the quanti- 
tative portion of the Admission Test 
for Graduate Study in Business. If this 
finding proves general, the opinion 
that grades are a conglomerate may be 
questioned. Hence, the study should 
be of interest to testing theorists and 
psychometricians, as well as to gradu- 
ate business school admissions per- 
sonnel. ATGSB. 



Discrepant Predictors Study for the 
Admission Test for Graduate Study 
in Business. 

ROBERT F. BOLDT 

One familiar dilemma that admissions 
officers face is how to decide among 
candidates whose test scores and 
grade-point, averages do not clearly 
point to the same conclusion as to the 
candidate’s potential ability. A similar 
problem is faced by the researchers 
who, in carrying out validity studies, 
must develop a predictive system that 
works no matter what configurations of 
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test scores- and undergraduate grades 
arc available. The purpose of this study 
was to see whether the methods of the 
validity study might be used by the 
admissions officer. In general, the indi- 
cations are that the regression — equa- 
tion approach used in validity studies 
does work reasonably well and can be 
used to resolve the conflicting informa- 
tion with which the admissions officer 
deals. The research should be of in- 
terest to graduate school admissions 
officers and test developers. ATGSB 
Brief No. 2, June 1969. 

Criterion Study: ATGSB. 

LOIS A. CROOKS 

The broadening of criteria for selection 
purposes is a long-standing and difficult 
problem in testing. For example, college 
grades have, long served as useful 
criteria for determining the validity of 
cognitive measures, such as the apti- 
tude and achievement measures now in 
general use. The fact that success in 
school — and in life — also depends on 
qualities not measured by aptitude or 
achievement tests has led to persistent 
efforts to create useful measures of 
noncognitive qualities, such as those 
of personality or motivation. However, 
it has been extremely difficult to estab- 
lish criteria as obvious and quantifiable 
as grades for validating measures of 
these other qualities. The purpose of 
this study is to identify criteria that 
might be useful in validating tests of 
noncognitive qualities that graduate 
schools of business most desire in their 
students. During the first phase of the 
study some desirable qualities wore 
identified and rating scales were de- 
veloped. In phase two, a biographical 
data form was developed and pilot 
studies were carried out in graduate 
schools of business, In phase three, 
noncognitive data from the biographi- 
cal data form are being used along with 
undergraduate grade-point averages and 
scores on the Admission Test for 
Graduate Study in Business to see 
whether adding the noncognitive data 
improves the predictability of perform- 
ance by graduate business school stu- 
dents. The research should be of in- 
terest to researchers in test develop- 
ment and higher education, ATGSB. 



ATGSB New Item Type Research. 

ALFRED B. CARLSON 

This study investigates the validity of 
three new item types for predicting 
success in graduate study in business. 
One item type, the Common Word type, 
requires the candidate to give associa- 
tions for three words and then find the 
one word that is common to all three. 
A second item type, Quantitative Com- 
parison , requires him to state which of 
two quantities is greater, to assert 
their equality, or to assert lack of 
suflicient data to reach a judgment. A 
third type, Practical Business Judg- 
ment, requires the reading of a short 
background piece on a business execu- 
tive with a hypothetical problem, and 
then to make the classifications and 
judgments necessary to solve the prob- 
lem. Item writing has been completed, 
test copy and a supervisor’s manual arc 
being prepared, and six schools with a 
total of about 1,500 students will 
participate in a field testing of the new 
approach. The research should be of 
interest to graduate business school 
admissions personnel and test devel- 
opers. ATGSB. 

ATGSB Moderator Variable Study. 

BARBARA PITCHER, HERMAN SMITH 

This exploratory study was undertaken 
to sec if certain variables might act as 
moderators in predicting the average 
grades of students during their first 
year in graduate business school. For 
example, a moderator variable, age at 
entrance to graduate business school , 
underlies such a question as, “Are 
predictions based on atgsb scores more 
accurate for younger students or for 
older students?” Other moderator 
variables of this nature raised such 
questions for research as, “Are predic- 
tions more accurate for fulltime stu- 
dents than for part-time students? Does 
predictive accuracy differ according to 
undergraduate major field or the ex- 
cellence of candidates from particular 
undergraduate colleges? Would pre- 
dictions using atgsb scores and grades 
be more accurate if separate prediction 
equations were used for groups defined 
according to these moderator vari- 
ables?” Data collected from 26 gradu- 
ate schools indicated that predictions 



FROM THE DESK OF G. STANLEY SALVATl 



Rip: ■ 

: Thought you ought to know, as one old 
friend to another, that the Manager of the service 
department of the new discount chain store is 
trying to hire away our electronics technicians. • 
One of my men said this guy called him at home 
and offered him two bits an hc^ir more than our 




Developed by ets in collaboration with a variety of organizations, "in-basket” 
tests have become a widely used measure of managerial potential. Each test 
is a simulation of real problems that a manager must solve in a particular job. 
As the name "in-basket” suggests, fictional memoranda, letters, notes, and 
other documents convey problems to the desk of a manager. The person taking 
the tests responds to these problems with various directives, which are rated 
for appropriateness and according to other criteria. Samples on this and the 
next page arc from the J. C. Penney Company Service Center Manager In- 
Basket. (See Crooks, hi-Baskct Study.) 




71 



are more accurate for younger students 
than for older students, and for full- 
time students than for part-time stu- 
dents. The predictive effectiveness of 
atgsb scores and undergraduate grades 
also seems to be influenced in a small 
but consistent 'way by undergraduate 
major field and college. The research 
should be of interest to graduate school 
admissions personnel and test develop- 
ers. ATGSB. SK-68-65. 

In- Basket Study. 

LOIS A. CROOKS 

A sizable problem for graduate business 
school admissions people is deciding 
which students to select from among 
the marginal candidates — that is, ap- 
plicants whose scores on the Admission 
Test for Graduate Study in Business, 
undergraduate records, and other data 
place them in the lowest category of 
possible admittees but in larger num- 
bers than there are places available. A 
related problem is the 1 selection of 
candidates who not only may complete 
the academic program successfully, but 
who may also have other attributes 
needed for success in business careers. 
(The problem here is pointed up by the 
fact that follow-up studies of business 



school graduates have shown little or 
no relation between their grades in 
business schools and later career prog- 
ress.) This study is investigating the 
possibility of using an "in-basket” test 
as an aid in selection for admissions. 
The in-basket simulates the solving of 
management problems, and research 
over the years in a variety of industrial 
settings indicates that in-basket per- 
formance appears to be related to 
actual managerial career progress. An 
in-basket test was administered to can- 
didates in several graduate schools of 
business in the fall of 1969 together 
with a biographical data questionnaire 
and several personality measures. The 
data will be analyzed using grades and 
faculty ratings as criteria. When fin- 
ished, the research should be of inter- 
est to researchers in test development 
and higher education. ATGSB. 

The Moderating Effect of TOEFL on 
ATGSB . 

AMIEL T. SIIARON 

Foreign students who want to enroll in 
American business schools are fre- 
quently examined with both the Test of 
English as a Foreign Language (TOEFL) 
and the Admission Test for Graduate 
Study in Business (atgsb). Since no 



information is available as to whether 
TOEFL adds to the predictive validity of 
the ATGSB for foreign candidates, this 
study combined the two tests to see 
how well they predict business school 
grade-point average. When completed, 
the research should be of interest to 
graduate business school admissions 
personnel. ATGSB. 

Selection of MBA Candidates for 
Later Job Effectiveness. 

THOMAS W. HARRELL 

To what extent can students with man- 
agement potential be identified prior to 
admission to a graduate school of busi- 
ness? This question was explored by 
Dr, Thomas Harrell of Stanford Uni- 
versity’s Graduate School of Business 
v r ith support by the Policy Committee 
of the Admission Test for Graduate 
Study in Business (atgsb). In this 
initial phase 64 men from the class of 
1961 and 104 from the class of 1962 
took a series of tests and questionnaires 
while they were in school. The atgsb 
Brief No. 1, published early in 1969, 
describes the study and its implica- 
tions. The research should be of in- 
terest to admissions personnel in grad- 
uate schools of business. ATGSB. 



Cultural Diversity and the Disadvantaged. 



Disadvantaged Children and Their First 
School Experiences: A Longitudinal 
Study. 

SCARVIA ANDERSON, ALBERT BEATON, 
JOSEPH BOYD, VIRGINIA SHIPMAN, et al 

During the summer of 1969, about 
2,000 4-year-olds in Lee County, Ala- 
bama; Trenton, New Jersey; St. Louis, 
Missouri; and Portland, Oregon, be- 
came part of a six-year study of educa- 
tional and social programs for dis- 
advantaged children. Study plans and 
operations include a close look at the 
families and communities of the chil- 
dren, in order to appraise their roles — 
in interaction with preschools and 
schools — in fostering children’s men- 
tal, social, emotional, and physical 







development. The ultimate goal of the 
study is to provide information useful 
for educational and social planning at 
federal, state, and local levels. Al- 
though the study has been described by 
leading social scientists as "potentially 
the most significant single piece of 
educational research in this decade,” 
its origins were simple and straight- 
forward: The federal government is 
spending hundreds of millions of 
dollars on Head Start and other early 
childhood programs, and there is a 
pressing need to know not only what 
kinds of outcomes these programs are 
producing, but also what can be done 
to improve them in the future. The 
present effort is an attempt to provide 
reliable information for program evalu- 



ation. It is also designed as basic re- 
search on how human development is 
sequenced and structured; as social 
research on the pressing domestic 
problems of both poverty and aliena- 
tion from the mainstream of society; 
and as a "practicum” in how to do 
research in the real world and how to 
put the knowledge gained from such 
research to practical use as quickly as 
possible. The study communities are 
fully involved in the research — ad- 
ministratively, financially, and pro- 
fessionally. For example, the testers, 
observers, and interviewers are not the 
usual outside researchers with clip- 
boards, but neighborhood mothers who 
have been given special training. Ad- 
visers include Samuel Messick, Albert 
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Beaton, Walter Emmcrieh, and Winton 
Maiming, ets; Edmund Gordon, Colum- 
bia University; Marshall Smith, Tren- 
ton State College; Silvan Tomkins, 
Rutgers University; Melvin Tumin, 
Princeton University; Urie Bronfen- 
brenner, Cornell University; Boyd 
McCandless, Emory University; Alfred 
Yankauer, Harvard University; and 
Edward Zigler, Yale University. The 
study is supported principally by a 
grant from Project Head Start, Office of 
Child Development, HEW. TR-70-2. 

Classroom Variables. 

DONALD M. MEDLEY 

One problem facing those working on 
the ETS-Iiead Start Longitudinal Study 
is how to obtain a reasonably adequate 
record of what happens to the children 
in their classrooms. What do teachers 
do and what do the children do that 
might relate to what is learned? What 
seems to turn them on? Or turn them 
off? The mission of one group of ets 
psychologists, who constitutethe "class- 
room task force,” is to obtain compre- 
hensive records of the classroom ex- 
perience of the individual child and to 
develop ways of putting this informa- 
tion into a quantitative form for statis- 
tical analysis and to test various hy- 
potheses. To do this a new instrument 
called the Person a l Record of School Ex - 
periences , or PROSE, has been developed 
and pretested. During a pilot study 
local people in the various longitudinal 
study communities were trained to use 
the new instrument, acting as class- 
room observers. The pilot study was 
also used to provide data for testing 
computer programs that are being 
developed for the storage and retrieval 
of information gathered by PROSE. Proj- 
ect Head Start. RM-69-15. 

Planning for Innovation: A Case Study 
of the New York City School - 
Community Interaction Umbrella 
Program . 

GEORGE G. GORDON 

A problem of great current importance 
throughout American society is how 
administrative power is to be shared 
between central and decentralized 
authorities. In education one of the 
most dramatic eruptions of this issue 
has come within New York City, where 
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it has proved considerably easier to 
recognize the need for decentralization 
than to effeet it. This study was of a key 
local problem — how the newly formed, 
decentralized, administrative boards 
organized themselves to implement and 
oversee a variety of Title III projects in 
various communities. Observers at- 
tended meetings of four such decentral- 
ized boards as well as a number of 
interboard meetings. Copies of written 
communications between the boards 
and the Board of Education office 
monitoring the project were also ob- 
tained, and these inputs were analyzed. 
The study indicated that the boards 
spent most of their time defining their 
role, their responsibilities, and their 
authority. However, progress was made 
overall, and although the atmosphere 
was often abrasive and hostile, the 
sehool and community people involved 
were generally hopeful about the po- 
tential for effective school-community 
interaction. The research should be of 
interest to educational planners for 
urban areas, school administrators, 
and school boards. 



Test and Job Performance of Various 
Subgroups Within Specijied 
Occupations. 

JOEL T. CAMPBELL, RONALD L. FLAUGIIER, 
LEWIS W. PIKE, DONALD A. ROCK 

This study sought to determine the re- 
lationships among aptitude tests, cri- 
teria of job performance, and back- 
ground faetors for Negro groups in 
Comparison with white groups. One 
finding was that Negro and white super- 
visors evaluate Negro and white sub- 
ordinates on quite different bases. 
Another finding was that the factor 
structure of aptitude tests for Negroes 
and whites shows some differences, but 
overall shows more similarities than 
differences. Though similar studies 
have been done, the data for this proj- 
ect were collected from a larger sample 
than in previous studies. Results 
should be of special interest in demon- 
strating the difficulties of adequately 
validating tests for diverse ethnic 
groups. In relation to education, they 
also raise some practical questions 
about the assignment of course grades 
to students from different ethnic 
groups. The research should be of 




interest to personnel and measurement 
specialists, and those generally con- 
cerned with equal opportunity. Ford 
Foundation. PR-69-4. PR-69-5. PR-69-6. 

Evaluation of the Integration of 
Evanston District 65 Schools. 

DANIEL P. NORTON, JAYJIA HSIA 

Such studies as the giant cross- 
seetional Educational Opportunities 
Survey have shown that generally 
speaking, across the nation, integration 
very importantly affects education. 
Many questions remain, however, of 
how and why this happens. Such 
questions can only be answered by fol- 
lowing the same students over a period 
of years using the methods of the longi- 
tudinal study. This study, which started 
in 1967, is following the progress of 
children in the Evanston, Illinois, 
school district through June of 1971. 
Both eross-scctional and longitudinal 
analyses arc being made of achievement, 
attitude, socioeconomic status, and 
other kinds of information on the chil- 
dren. When completed, the research 
will be especially relevant to studies of 
integration and of equality of educa- 
tional opportunity because of the 
scarcity of studies of this nature. The 
completed research should be of in- 
terest to the general public, school 
boards, school administrators, and 
human growth and development spe- 
cialists. Rockefeller Foundation. PR- 
69- 10. 

Chicago Title I Evaluation. 

GARY L. MARCO 

Administering Title I funds for edu- 
cational innovations affecting the dis* 
advantaged poses a number of prob- 
lems. In Chicago some of these prob- 
lems have been particularly acute be- 
cause of the size of the school system 
necessary to serve the nation’s third 
largest city. This study was designed to 
answer two questions of pressing im- 
portance to Chicago Title I fund ad- 
ministrators: How effective are the 
various programs funded by Title I 
in the city? How might these funds best 
be allocated to the various programs? 
An extensive opinion sampling of those 
"in the know” throughout the city and 
the school system was carried out. It 
(continued on page 80) 




A child’s self-perception and his feelings toward 
people and places of significance in his environment 
may; be gauged by the Social Schemata Task. The 
child first chooses a figure to represent himself from 
among the four self figures shown above: a boy, a 
girl, black or white. He is then equipped with a sheet 
of His. own self figures on pressure-sensitive labels. 
He pastes; these self-figures onto sheets of paper that 
show the impprtaf e^ people^^ and places in his life ; 



indicated below— mother, father, teacher, friends, 
both black and white, and his home and school. In 
this way the child may reveal relatively quickly 
many things bf .fundament his 



6f the task in use are shown overleaf. (See Anderson, 
Disadvantaged Children and Their First School Expe- 
riences: A Longitudinal Study .) C \; \ \\ 
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example 1: The child places himself near the mother. This proximity of the two figures might 
indicate a sense of being close to his mother. An exact interpretation must^ of course, 
take into consideration all responses to the Social Schemata Task as well as other 



assessments. 







■ example ; 2 : Th e child places heirs hopie. This might indicate some degree of negative 
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To measure a young child’s domain of general knowledge the testing instrument 
must be sensitive to both individual and cultural differences. On this and the 
overleaf page arc shown items from the TAMA General Knowledge Test (Tl). 
The child is shown a card with three comparison objects and asked the ques- 
lions indicated. (See Anderson, Disadvantaged Children and Their First School 
Experiences: A Longitudinal Study.) 



Which letter is ready to mail? 
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Which is most like the flag of our country? 




Which dog might bite? Which could you use to cut a piece of wood? 
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( continued on next page) 



Which of these do firemen use when they put out a fire? 



Which one shows what most children do late at night? 





Which one do you blow to make music? Which of these has wings? 






V7 



COPYRICHT © 1969 HY EDUCATIONAL TESTING SERVICE. ALL RIGHTS RESERVED. 






o 

ERIC 



78 



79 



revealed favorable attitudes toward 
Title I programs by school superin- 
tendents, principals, teachers, and 
school-community representatives dur- 
ing both the 1967-68 and 1968*69 
school years. Most wished the programs 
to he continued, usually with only 
minor changes. A mathematical model 
of a decision-making process whereby 
Title 1 programs might bt effectively 
evaluated by the Chicago school system 
was also developed. The study ex- 
plores in some depth many aspects of 
the evaluation of compensatory edu- 
cation programs. Reports arc in re- 
stricted circulation. 

Objective, Achievement Testing for the 
Evaluation of Chicago Title 1 Projects. 
DANIEL P. NORTON 

The usefulness of standardized achieve- 
ment tests for Title T project evaluation 
in Chicago was also the subject of a 
study by the ETS Midwestern Office. 
Specifically, use of standard achieve- 
ment tests for pretesting and posttest- 
ing tens of thousands of pupils was in- 
vestigated. Scores were subjected to 
multiple modes of analysis. Numerous 
artifacts — or meanings peculiar to this 
situation — were identified that must be 
understood if outcomes are to be inter- 
preted correctly (for example, between 
battery differences, raw score versus 
grade-equivalent modes of analysis, 
and so forth). Reports are in restricted 
circulation. 

Evaluation of the Verona Plan for 
Sharing Educational Opportunity. 
STANLEY lM. ZDEP 

Will the education of children from 
predominantly black ghetto schools be 
advanced if they are bused to pre- 
dominantly white suburban schools? A 
research study on this problem was 
carried out by ets for the town of 
Verona, a suburb of Newark, New 
Jersey, to which 26 first and second 
graders were bused from Newark for 
schooling. The research design pro- 
vided for comparison of the achieve- 
ment of bused children with the 
achievement of a comparable group 
who remained in the ghetto schools. It 
was found that reading, math, and 
listening achievement test scores of 
bused first graders were significantly 
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higher than those of uribused first 
graders. No significant differences in 
these subject areas were found between 
bused second graders and their coun- 
terparts who remained in ghetto 
schools. The research should he of 
interest to educators, psychologists, 
and others contemplating new busing 
ventures, or assessing those in exist- 
ence. 

Miami Bilingual Student Study . 

ROBERT F. BOLDT 

The special needs of students who must 
live and perform in two cultures are 
gaining more recognition from educa- 
tors. One such group consists of the 
bilingual Spanish- and English-speak- 
ing students, primarily of Cuban de- 
scent, who live in Miami, Florida. A 
practical question for the Dade County, 
Florida, school authorities was whether 
special weigh rings might be useful for 
equating the scores of bilingual stu- 
dents with nonbilingual students on 
the Scholastic Aptitude Test (sat) and 
the Prueba dc Aptitud Acadcmica. 
This study attempted to find some basis 
for differential weightings using lan- 
guage orientation and socioeconomic 
ratings. It was found that use of the 
mathematical part of the SAT alone, 
or the sat-m as it is known, seemed to 
be as practical and valid as any of the 
more complicated prediction schemes 
that were examined by the study. The 
research should be of interest to edu- 
cators and test developers concerned 
with testing bilingual populations. 
CEEB. RDR-68-9. SR-69-31. 

Vocational Development Study — 
Patterns of Negro- White Differences. 

MICHAEL ROSENFELD 

Few longitudinal studies of black and 
white patterns of intellectual growth 
have been made. Most studies of this 
nature are cross-sectional, with growth 
patterns inferred over differing sample 
populations. This study was unusual 
in observing changes in the same sub- 
jects over a period of six years. The 
subjects were 316 blacks and 501 
whites in schools of differing curricular 
emphasis and ability range within the 
systems of two cities, one midwestern 
and one western. Multivariate analyses 
of variance were carried out on the 



scores of these students at grades 5, 7. 
9, and 11 on the Sequential Tests of 
Educational Progress (step) and the 
School and College Ability Tests (scat). 
A measure of socio-economic status 
was also obtained from l lie Back- 
ground and Experience Questionnaire 
for these students. In general, the re- 
sults corroborated the findings of most 
other studies that describe the intellec- 
tual performance patterns prevailing in 
our schools today. In general, test 
scores of white subjects were signif- 
icantly higher than those of blacks at 
grade 5 on all tests of scat and step. 
Moreover, the whites not only started 
out higher, but they grew at a faster 
rate than the blacks. In other words, 
the gap widened between students of 
the two races from grade to grade as 
they progressed through high school. 
Such findings have been used by 
racists and others to support a conten- 
tion of innate intellectual differences 
between the races. The more environ- 
mentally oriented, however, claim such 
findings reflect the depressing effect of 
socially and individually low expect- 
ancies for blacks and of possibly sub- 
standard schools and communities. 
Though this study by design could do 
little beyond record existing general 
performance patterns, in keeping with 
the environmentalist view it did find 
evidence of differences between schools 
in gains made by both blacks and 
whites. It also found that both blacks 
and whites continued to grow on all 
tests of scat and step, and that there 
was no test on which either blacks or 
whites showed a decline from one 
testing period to the next. 

Assessment of Disadvantaged 
Adolescents: A Different Approach 
to Research and Evaluation Measures. 

NORMAN E. FREEBERG 

A great deal of attention has been given 
to the question of whether racial bias 
exists in many standardized tests whose 
use affects minorities. Attention has 
also been given to modifying these tests 
and eliminating bias. However, a sur- 
prisingly small investment has been 
made in the development of new meas- 
ures specifically tailored to the needs, 
interests, and skills of these minorities. 
This is the purpose of this study — the 



development of a battery of 13 meas- 
ures specifically designed to assess tiie 
abilities of adolescents from culturally 
deprived, poverty-level backgrounds. 
Measures now in use with such groups 
have been heavily criticized for limita- 
tions such as entirely verbal formats, 
reading levels that are too nigh, a cul- 
turally biased content expressed in 
terms of majority group language and 
concepts, too great a length — 50 to 100 
items per test, being designed for large- 
group administration with the examiner 
remote from the respondent, tight time 
restrictions, and the like. To counter 
such shortcomings, the measures de- 
veloped by this study are in small- 
booklet form, with numerous pictures, 
and arc designed for small group ad- 
ministration. The verbal content is 
maintained at a fifth grade reading 
level; subject matter is relevant to 
disadvantaged backgrounds; and the 
number of items per booklet range from 
a minimum of 10 to a maximum of 30. 
The approach has been shown to have 
reasonable promise after having been 
tried with a group of 256 high school 
dropouts who are enrolled in 11 Neigh- 
borhood Youth Corps project centers 
primarily in urban areas of the north- 
east. Bureau of Work Training Pro- 
grams, U. S. Department of Labor. 
RB-69-41. Journal of ■ Educational Psy- 
chology — In press. 

Project Access Evaluation. 

AMI EL T. SHARON 

Project Access is a program that is 
intended to help disadvantaged high 
school students gain access to college 
or other institutions of postsecondary 
education. This study was an evalua- 
tion of the project’s potential in terms 
of three questions: Will students who 
wouldn’t normally do so apply or enroll 
in college because of Project Access? 
Which parts of the projected project 
are effective, am! which ineffective? 
How might the project be improved? 
Approximately 70,000 juniors and 
seniors in 99 inner-city high ’schools 
were tested with the Preliminary 
Scholastic Aptitude Test and com- 
pleted a short questionnaire. This 
information was distributed to the par- 
ticipating high schools and to more 
than 500 colleges. Findings were then 
based on follow-up questionnaires and 



interviews. Among the high schools 
and colleges an overwhelming majority 
indicated that the instruments used in 
the project provided them with useful 
information, but college personnel also 
offered many suggestions for improve- 
ments. Colleges experienced several 
problems: they had difficulty in track- 
ing down prospective students because 
their home addresses were not given, 
were overwhelmed by the amount of 
data, and lacked the staff and the time 
to contact students. Most of the stu- 
dents who were interviewed had favor- 
able reactions to Project Access. About 
65 percent of them indicated that they 
had applied or were planning to apply 
to a college, while three out of every 
ten students said that the project made 
them start thinking about college. The 
project appears to have had a greater 
effect on juniors than on seniors, so 
its full impact will probably not be felt 
until fall 1970. CEEB. 

Dimensions of Social Stratification 
for Whites and Negroes. 

LAWRENCE J. STRlCKER 

Starting with the ground-breaking work 
of Lloyd Warner in "Yankee City,” a 
vast amount of research lias been de- 
voted to developing indexes of social 
class that can be used to classify people 
as "upper class,” "middle class,” 
"lower class,” and so on. Although 
this research has been based almost 
entirely on samples of whites, these 
indexes are often applied to Negroes, 
despite evidence that the indexes may 
not be comparable for the two groups. 
This study seeks, first, to identify the 
dimensions of social stratification for 
both races. Unlike previous studies, it 
uses samples of both races. It also seeks 
to determine whether distinct social 
classes acLually exist — that is, whether 
the different classes can be clearly 
demarcated, or whether they simply 
represent gradations on a continuum, 
one group blending imperceptibly into 
another. The data are being gathered 
in highly structured interviews with 
cross-sections of both races. When 
completed, the research should be of 
interest to sociologists, psychologists, 
and others (social workers, teachers, 
educational planners) who use social 
class indexes in their work. Aside from 



its implications for social stratification, 
it should also provide an interesting 
description of white and Negro cul- 
tures. NIC H HD. i 

Cross-Cultural Study of the Effect of 
Instructions on the Miiller-Lyer Illusion 
JULIA CARLSON 

All interesting finding is that, When 
confronted with a certain type of opti- 
cal illusion, black Africans tend to be 
less susceptible to being "fooled” by 
it than white Americans. Segall, Camp- 
bell, and Herskovits in The Influence of 
Culture on Visual Perception attempted 
to explain this difference in terms of a 
theory of Iiowcnvironmental influences 
might account for it. By certain refine- 
ments in testing procedures, this study 
attempted to go beyond the Segall, 
Campbell, and Herskovits conclusions 
by relating this perceptual difference to 
the highly specific experimental work 
and theory of selective attending. The 
study demonstrates that selecti ve atten- 
tion is an important determinant of 
differences in perception, but that it 
will not account for the differences 
found by Segall, Campbell, and Her- 
skovits. Regarding the question of in- 
nate versus environmental differences, 
it demonstrates how difficult it is to 
separate the two in research, and to 
obtain clear-cut findings. The research 
should be of interest to psychologists 
interested in perception and cross- 
cultural studies. RB-68-53. 

Home Environment and Educational 
Development . 

THOMAS L. HILTON, DONALD L, LANTZ, 
CATHLEEN PATRICK 

Recent studies haye indicated that 
process variables in the home — such as 
encouragement to continue education, 
parental interest in achievement, and 
availability of reference material — may 
be useful predictors of academic status. 
This study uses Growth Study data in 
an attempt to see what sort of relation- 
ship may exist between students’ per- 
ceptions of process variables of this 
type and their actual academic growth. 
Academic growth was gauged by meas- 
ures such as step and scat, and the 
students’ perceptions were derived 
from the Test of General Information 
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(tci) and Background and Experience 
Questionnaire (beq) data. A seale 
made up of beq items that seemed to 
relate to students’ perceptions of fam- 
ily environment was developed. Stu- 
dents’ seores on this seale were com- 
pared with the measures of aeademie 
growth and some interesting correla- 
tions emerged. Currently, the seale is 
being revised. The research should be 
of interest to researchers studying the 
relation between home environment 
and education. 

Socioeconomic Status and 
Academic Gain. 

THOMAS L. HILTON, CATHY JEAN CORES 

This study made use of Growth Study 
data to explore some possible relations 
of soeiocconoiniestatus (ses) to academ- 
ic gains. Three hypotheses for testing 
were derived from the work of a leading 
theorist in this area, Benjamin Bloom. 



Bayesian Guidance Technology . 

MELVIN R. NOVICK, PAUL ;t. JACKSON 

Mu eh of the application of statistical 
theory is concerned with methods of 
estimating probabilities. For example, 
predicting a student’s eollege perform- 
ance from high sehool tests and grades 
is, at the heart of it, a matter of arriving 
at a judgment based on probabilities. 
Thus, questions of probability methods 
and theory are fundamental to testing. 
For a number of years a controversy 
has existed among theoreticians over 
the suitability or nonsuitability of 
what are known as Bayesian methods, 
after the British clergyman who pio- 
neered this approach to probability 
theory during the eighteenth eentury. 
Bayesian methods have been relegated 
to the "baek shelf” in testing until 
quite recently beeause of eertain un- 
resolved complexities. However, a 
erueially important new development 
in testing is now foreing serious con- 
sideration of a fairly general imple- 
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Hypothesis I was that gains in achieve- 
ment would vary aeeording to the SES 
of the student’s parents. Hypothesis II 
was that gains in achievement over a 
period of time would be independent 
of the level of achievement at the begin- 
ning of this period — that is, that those 
seoring high at the beginning of the 
time period would show about the same 
rate of aeademie gain as those seoring 
low. Hypothesis III was that students 
grouped heterogeneously aeeording to 
SES would show a significantly greater 
range of gain seores in achievement 
than students who were grouped homo- 
geneously. Gains in achievement and 
mathematics were examined for a sam- 
ple of 1,400 students from grades 5 
through 9. No support was found for 
hypothesis I. Hypothesis II was rejected 
for mathematics, but seemed to hold 
for reading. No gcncraiizablc results 
were found for hypothesis 115, The re- 
search should be of interest to re- 
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mentation or switeh-over to Baye- 
sian methods in testing. This develop- 
ment is the shift in thinking about 
testing that is coming about through 
the widening confrontation of educa- 
tion with social need. That is, the tra- 
ditional emphasis in testing has been 
on the selection of relatively few peo- 
ple out of many, and on a basis of a few 
abilities out of many, for speeial train- 
ing. However, an increasingly well- 
artieulated situation of soeial need 
clearly calls for more use of testing for 
guidance and placement of the many 
rather than selection of the few, and 
aeeording to an evaluation of many 
rather than few abilities. This view is 
best explained within the Educational 
Testing Serviee eontext in an ariiele, 
"Relevanee in Testing,” by Dr. William 
W. Turnbull, President of ets. Some 
Bayesian theorists see their methods as 
ideally suited to elTeet the least trouble- 
some and most effective ehangeover in 
the methods and statistical thinking 
neeessary for broadening testing to 




searchers examining the relation of 
SES to education. 

Professional /Technical Assistance to the 
Head Start Research and 
Evaluation Demonstration Program 

RUTIi B. EK STROM 

The Head Start program to ready dis- 
advantaged youngsters for sehool has 
proven to be one of the most popular 
soeial measures to emerge out of the 
"Great Soeiety” program years. Part 
of this particular projeet has involved 
a review of a number of earlier reports 
on Head Start. It has also involved a 
elassroom description study, a review 
of research proposals, and participa- 
tion in six research seminars, the pro- 
ceedings of whieh are now available 
from the Head Start ofhee in Washing- 
ton. A eolleetion of tests for use with 
preschool children is also being com- 
piled and indexed for use by the Head 
Start ofhee staff. Projeet Head Start. 



serve broader soeial ends. The issues, 
theory, and range of applications for 
test developers and statisticians are 
outlined in RB-69-83 by Noviek and 
Jaekson, whieh will appear in the 
October 1970 issue of the Review of 
Educational Research . NICHHD. 

System of Interactive Guidance 
and Information. 

MARTIN R. KATZ, WILLIAM F. GODWIN 

A computerized, interactive guidance 
and information system is being de- 
veloped to improve eareer decision 
making by junior eollege students. The 
projeet is a response to the nationwide 
need for eareer guidance for students 
in junior colleges. Students will be 
able to use the computer and related 
technologies to explore their own 
values, to obtain and interpret informa- 
tion, to make predictions, and to for- 
mulate and rehearse eareer plans. The 
system emphasizes wisdom in the proc- 
ess of eareer decision making rather 



In-basket test flexibility allows use of a job-simulation approach in a wide range 
of occupational settings. The sample test materials on this and the next page 
are from the Foreman’s Shop Desk In-Basket developed by ets in collaboration 
with the Caterpillar Tractor Company. The prospective shop foreman who is 
being tested receives a note from another foreman, who has left in a hurry for 
the hospital with his pregnant wife, leaving him to carry out the work indicated 
on t lie shop line-up sheet. The prospective shop foreman must respond to this 
task with various work directives and assignments, on the basis of which his 
performance is rated. (Sec Crooks, In-Basket Development and Research.) 
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than "correctness” in conforming to 
some predetermined standard. Pre- 
eminent is the role of each student’s 
own values. In short, the system is 
based on a humanistic ethic, with con- 
trol vested in the student. The research 
and developmental work should be of 
interest to junior college students, 
guidance specialists, and junior college 
administrators. It also relates to re- 
search in guidance theory, vocational 
development, computer technology, 
manpower planning, and occupational 
information. Carnegie Corporation. 
Articles on the system have appeared 
in the College Board Review, Summer 
1969, and in Computer-Based Vocational 
Guidance Systems (U. S. Office of Edu- 
cation, 1969, pp. 10-15 and 72-76). 

A Study of Intellectual Growth and 
Vocational Development . 

TIIOMAS L. IIILTON, PATRICIA L. CASSERLY, 
FRANKLIN R. EVANS, NORMAN E. FREEBERG, 
WILLIAM F. GODWIN, MARTIN R. KATZ, 
MICHAEL J. PATTON, DONALD A. ROCK, 
MICHAEL ROSENFELD, JONATHAN R. 
WARREN 

In this study the Growth Study data 
are used to trace the intellectual de- 
velopment of students who choose 
vocational rather than college prepara- 
tory curricula in high school; to ex- 
amine the interaction over time of 
their individual natures, plans, en- 
vironmental influences, and eventual 
occupations; and to develop a theoret- 
ical model of vocational development. 
A number of studies have been 
launched for these purposes. A Voca- 
tional Decision-Making Study devel- 
oped an interview schedule to collect 
data on this topic. A Curriculum Group 
Achievement Study involved multi- 
variate analysis of such variables as 
School, curriculum, sex, and socio- 
economic status. In Simulation of Cur- 
riculum Assignment Process an attempt 
is being made to develop a computer 
simulation of the process whereby 
students become involved with a par- 
ticular curriculum. In the Follow-Up 
Study, questionnaires were sent to 
graduates of Growth Study schools . 
to gather data to be used in com- 
paring high school progress with 
eventual job or^ school choices. The 
School Setting Study assessed the 
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effects of the communities as well as 
the schools on educational "climate.” 
The Biographical Factor Stability Study 
determined the usefulness of the Back- 
ground and Experience Questionnaire 
for the overall study. Moderated Pre- 
diction Within Curriculum examined 
extensive data on 900 students to de- 
scribe how personal characteristics in- 
teract with achievement and curric- 
ulum. The Dropout Study sought to 
identify behavior patterns of students 
who drop out of high school. The Study 
of Negro-White Differences compared 
growth patterns as measured by the 
School and College Ability Tests and 
Sequential Tests of Educational Prog- 
ress for Negro versus white students 
over grades 5, 7, 9, and 11. Of many 
findings, three generalizations were 
these: (1) though some trends were 
found, it was difficult to generalize, 
each school tending to be unique, (2) 
family status seems to have great im- 
pact on choice of curriculum and per- 
formance, and (3) large-scale multi- 
variate analytical techniques, while 
powerful, must be supplemented with 
other data collection and analytical 
methods. USOE. RB-69-29, RB-69-32. 

Vocational Development 
Follow-Up Study . 

JONATHAN R. WARREN 

The traditional view of education is 
that its purpose is to prepare us for 
what comes after we leave school — 
for a job, a career, or an enjoyable re- 
tirement. Thus, it is rather ironic 
that while numerous studies have been 
made of what happens to us while 
we’re in school, relatively few follow- 
up studies are carried out to see what 
happens afterward. This study is par- 
ticularly rare in being an attempt to 
relate the high school experience of 
students in all curricula — vocational 
as well as college-preparatory — to their 
post-high school experience. Question- 
naires were sent to 6,800 graduates of 
Growth Study schools, and data for the 
Oakland, California, school system 
were extensively explored. In regard to 
the movement of high school graduates 
into jobs and colleges, one fairly gen- 
eral finding is quite thought-provoking. 
Except among girls w r ho were in voca- 
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tional curricula in high school, the 
association between high school curric- 
ulum and post-high school activity was 
very weak. That is, whether or not one 
had taken the vocational or the college 
preparatory curricula seemed to show 
relatively little relation to whether or 
not one was employed or in college 
after high school. This suggests that 
differentiation of high school curricula 
according to whether or not a student 
plans to attend college may not be a 
wise procedure. As a whole, the study 
found that college attendance, as op- 
posed to employment one year after 
high school graduation, was chiefly 
affected by the student’s verbal ap- 
titude and the social class of his parents 
as well as the curriculum followed in 
high school. Social class has a stronger 
effect on high school curriculum choice 
for women than for men. However, 
aptitude seems to be a stronger in- 
fluence than social class for both men 
and women. USOE. 

Effects of Organizational Climates. 

NORMAN FREDERIKSEN, OLLIE JENSEN, 
ALBERT E. BEATON, BRUCE BLOXOM. 

There is a tendency among personnel 
workers to believe that performance 
can be predicted from ability and per- 
sonality measures, without taking much 
account of variations in work situa- 
tions. This is a questionable belief, 
since situational variables may interact 
with personal characteristics to affect 
performance. The present study ex- 
plored this general question area in 
considerable depth with data from 260 
executives, each of whom served for 
two days as chief of a hypothetical 
field services division of a state depart- 
ment of commerce, using an in-basket 
test that simulated the paper work of 
an executive. Half of the subjects were 
led to believe that the department of 
commerce encouraged imaginative solu- 
tions to problems and cared little about 
Tules, whereas others were given the 
impression that it required close ad- 
herence to rules and regulations and 
discouraged innovation. An analysis of 
responses to the in-basket problem re- 
vealed 10 aspects of performance that 
could be considered in evaluating an 
executive, such as his productivity, 
tendency to analyze problems, pro- 
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crastination, and informality. The in- 
terrelationships of these criteria were 
influenced by organizational climates. 
For example, thoughtful analysis was 
associated with a tendency to work 
through one’s own organization in the 
rules climate, whereas in the innova- 
tion climate thoughtful analysis was 
associated with efforts to get out in the 
field and deal directly with the source 
of the problems. The research should 
be of interest to personnel officers and 
administrators of large organizations 
and to researchers in personality and 
social behavior. ONR, California State 
Personnel Board. RB-68-41. 

The Executive Study. 

LOIS A. CROOKS 

This is a project initiated by ets in 1955 
to stimulate research on various as- 
pects of selecting, assessing, and de- 
veloping executives. A number of com- 
panies joined together to support and 
participate in research of this nature, 
and in 1964 organized formally as the 
Executive Study Conference. Now 
comprising 25 companies, the group 
meets twice annually to discuss re- 
search related to this area. Reports of 
the meetings are published and should 
be of interest to personnel managers 
and industrial research specialists. 

In-Basket Development and Research. 
LOIS A. CROOKS 

The In-Basket Test is an approach to 
evaluation that attempts to assess 
managerial potential by simulating the 
problem-solving and administrative 
functions of an executive in terms of 
the flow of paperwork in his in-basket. 
That is, certain incoming memoranda 
present a problem, he records his de- 
cisions regarding it in outgoing memo- 
randa — and these outgoing memoranda 
are then evaluated according to stand- 
ards developed for each specific use of 
the technique. For several years ets 
has carried out research to develop the 
technique and apply it to specific or- 
ganizational needs. For example. Gen- 
eral Electric has administered a Plant 
Manager In-Basket Test, developed in 
cooperation with ets, to more than 
1,200 managers, with ets scoring the 



results and modifying the test as 
needed. The Consolidated Fund In- 
Basket — the only exercise of this type 
currently available at ets for purchase 
and general use — has the subject 
assume the role of a paid community 
fund director. Currently the subject 
of follow-up studies is another in- 
basket test developed in cooperation 
with the J. C. Penney Company for use 
in assessing potential service-center 
managers. The research should be of 
interest to those interested in manager- 
ial assessment and simulated task 
testing. 

Construct Validity of the CLEP 
Educational Psychology Subject 
Examination. 

ROBERTA B. FLESIIER 

The College-Level Examination Pro- 
gram, or Clef, as it is generally known, 
is a successful new attempt to answer 
a long-recognized educational need. For 
years, the self-educated — or those well- 
educated in spite of poor schools — 
have wondered why there couldn’t be 
some test they might take for which 
they might receive credit equivalent to 
that normally given after formal course- 
work at recognized institutions. Now 
there is such a program; clep offers 
tests of this nature in several fields. 
This study was to determine the valid- 
ity of a new clep test of proficiency as 
a result of instruction in an introduc- 
tory educational psychology course. 
Two large state universities partic- 
ipated in the validity study by adminis- 
tering the new examination at the be- 
ginning and at the end of their intro- 
ductory educational psychology 
courses. A significant increase in the 
average score from pretest to posttest 
indicated that the new test is a valid 
measure. The research should be of 
interest to test developers. SR-69-9. 
CEEB. 

JFGBH-TV Training Program for Law 
Enforcement Officials. 

RODERICK IRONSIDE 

Television’s potential as an instruction- 
al medium is highly attractive. How- 
ever, it poses many problems not only 



of programming, but also of evaluating 
programming. This project attempted 
to assess the impact of a series of five 
onc-hour telecasts beamed to police 
officers throughout New England. The 
programs were concerned with police 
responsibilities and suspects’ rights, as 
affected by the 1964-67 Supreme Court 
rulings. Prior to the programs, tests 
were mailed to a random sample of 
officers. Though response was meager 
and apparently selective, those who did 
respond indicated favorable reactions 
to the program content and format. 
However, in a pretest-posttest com- 
parison, no meaningful difference was 
found between those who had and 
those who had not seen the programs. 
The study should be of interest to re- 
searchers concerned with the problems 
of random sampling, test development, 
and teaching by television. 

Differential Behavior Patterns. 

GEORGE G. GORDON 

In obtaining names of prospective 
customers to call on, insurance sales- 
men have a choice of personal sources 
(such as referrals from past customers) 
versus impersonal sources (such as the 
telephone book). In training salesmen, 
many insurance companies stress the 
use of personal sources as the best 
method for all salesmen to use. This 
study, however, explored the question 
of whether one method was best for 
all. The results of personality tests 
given to 435 salesmen were compared 
with their managers’ descriptions of 
their actual performance on the job. It 
was found that while men with high 
ego strength did do best with leads from 
personal sources, those with low ego 
strength did not. A conclusion was that 
it is a mistake to base training entirely 
on the so-called top or ideal producer 
when the actual operation of insurance 
selling calls for some variation in types 
of men and the approaches natural to 
them. The study should be of interest 
to the insurance industry and other 
industries employing salesmen. An 
educational implication is that training 
should fit the man and the situation, 
rather than some logically derived 
"ideal.” 



Evaluation of Educational Systems 



National Assessment of Educational 
Progress. 

SCAKVIA B. ANDERSON, 

ARLEEN S. BARRON 

What is the status of education in the 
United States? Though the educational 
progress of the individual student can 
be assessed from grade to grade, there 
is at present no system for assessing 
the effectiveness of education as a 
whole throughout the country, or for 
determining whether overall educa- 
tional progress is being made. Educa- 
tional Testing Service is developing 
measures to be used for regular nation- 
al assessment of nationwide samples. 
The first administration of tests in 
three areas, science and writing (both 
by ets) and citizenship (by air) has 
been completed. Results may be avail- 
able in fall 1970. Pretests and special 
studies have already indicated some 
aspects of particular interest — for ex- 
ample, it has been found that school- 
age children not only can handle, but 
in fact enjoy, unusual test formats, 
such as the use of an "I don’t know” 
option added to the standard right- 
wrong, true-false format, the use of 
paced-tape presentation of questions, 
and "test packages” made up of ex- 
ercises from several areas and using a 
variety of formats. The sample for this 
study is of four ages (9, 13, 17, and 
young adults), both sexes, four regions, 
four community sizes, and two eco- 
nomic conditions; race may also be in- 
cluded as a variable. Tv/o or three 
content areas are included in each as- 
sessment year; reading and literature 
will be assessed in 1970-71. The re- 
search should be of interest to curric- 
ulum specialists, educators, and school 
administrators, and laymen concerned 
with education. In addition to its de- 
velopment of useful measures, it will 
provide a large data bank for research- 
ers and for test and curriculum 
developers. 

Educational Systems Information 
Program. 

DONALD A. TRISMEN, GARY L. MARCO 
In this time of rapid social change 
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many school administrators are con- 
fronted with a dilemma in planning and 
in accountability. They face such ques- 
tions as "What should be the goals for 
my particular school or school system?” 
And "How and where should the 
money be spent and how can I justify 
it?” These two questions are tied to- 
gether, for if one can specify clear-cut 
goals, and then be able to show progress 
toward them, one has solved the nub of 
the problems of both effective planning 
and cost accountability. The Educa- 
tional Systems Information Program, 
or ESIP, is being designed to provide 
such a service to administrators and 
school boards. Using special sampling 
techniques, esip would provide an ac- 
curate, comprehensive picture of a 
school in terms of the nature of its 
students, the homes they come from, 
the part of the community the school 
serves, and a range of student qualities 
and skills far beyond the customary 
important but narrow academic ability 
range. As projected, esip would present 
this information in a way that would 
make it possible for an administrator to 
periodically assess progress toward 
specific educational goals. Consulta- 
tions with interested school authorities 
and pilot studies are under way. In 
Cincinnati, Ohio, techniques of item 
sampling in the areas of mathematics 
in grades 8 and 9, and socioeconomic 
problems in grade 12 are being studied. 
The project should be of interest to 
community leaders as well as school 
administrators and boards of education. 



Methods of Measuring School System 
Performance. 

HENRY S. DYER, ROBERT L. LINN, 

MICHAEL J. PATTON 

For years the emphasis in testing has 
been upon evaluating the individual in 
terms of how well he measures up to 
the requirements of his school, How- 
ever, in keeping Avith other trends in 
this direction a new interest is devel- 
oping in evaluating the school and the 
school system to see how well they are 
doing by the students. That is the pur- 
pose of this study, and in some regards 
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it is a pioneering study of an extremely 
difficult area. The basic approach used 
is to obtain regression lines for a 
measure of student performance at one 
grade level compared with student per- 
formance measures at an earlier grade 
level. Deviations of school-system 
means from these regression surfaces 
are then used as indicators of school- 
system performance. Using this ap- 
proach, the possibilities of four differ- 
ent types of data were compared: (1) 
matched longitudinal data using in- 
dividual student scores for the regres- 
sion analysis, (2) matched longitudinal 
data using system means, (3) un- 
matched longitudinal data using sys- 
tem means, and (4) cross-sectional data 
using system means. The findings in- 
dicated that the first two methods 
yielded highly similar results and show 
promise. The latter two methods 
yielded results dissimilar from one an- 
other, and from the first two methods, 
and are not reasonable substitutes for 
the first two methods. The research 
should be of interest to educational 
researchers and educational systems 
administrators and planners. RB-68-55. 
American Educational Research Journal , 
6:4 (November 1969). 

Test Data as Social Indicators. 

WILLIAM B. SCHRADER 

Are we being educated any better today 
than we were, say, 10 years ago? Based 
on expenditures for education one 
would assume that we are. But know- 
ing for sure would depend on isolating 
some dependable indicators. This study 
attempted to do so by carefully ex- 
amining the body of work most rele- 
vant to this question — the extensive 
educational testing activities in the 
United States. Could any shift in per- 
formance level be detected over the 
past 10 years? It was judged that na- 
tional norms developed for six widely 
used tests were sufficiently comparable 
to throw light on possible trends. Ex- 
amination of data on high school stu- 
dents provided no clear-cut answer one 
way or the other. However, three in- 
dependent norms studies, which in- 
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Is American education getting any better over the decades? Answers to this 
question are usually a matter of opinion, with the assessments ranging from 
great optimism to predictions of scholastic bankruptcy. This chart summarizes 
some data that support optimism. Norms based on the testing of various groups 
in the 1950s were compared with norms for the same tests and comparable 
groups in the 1960s. Tn order to compare the groups the percentage of students 
in the new norms group who would score at or below the median of the old 
group was calculated. Thus, the smaller the percentage scoring below the old 
median, the greater the improvement shown by the new group. As the chart 
indicates, in all but five of the comparisons the new group was superior to the 
old group in performance. (See Schrader, Test Data as Social Indicators .) 
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eluded data for grades 5 lii rough 8, 
indicated that for this age group per- 
formance during the 1960s teas some- 
what belter than performance during 
the 1950s. The research should be of 
interest to l hose interested in systems 
evaluations of education. USOE. SK- 
68-77. 

Validation Plans for Driver Education 
Tra i n ing Progra ms. 

HARRY H. HARMAN 

The National Highway Safely Bureau 
(NJisn) is confronted with a sizable 
new responsibility. Federal funds have 
been specifically earmarked for dis- 
tribution to the slates for use in pro- 
grams aimed at culling l he rate of 
deaths and accidents on our highways. 
One countermeasure proposed was 
improved driver training. The niish 
funded four studies to determine how 
stales might best go about setting up 
such programs. Then it turned to ets 
for a final systems evaluation, including 
the findings of* l he four previous studies. 
That is, by viewing the operation of 
driver training programs as a system 
involving complex interactions ets de- 
veloped a plan for making scientific 
evaluations of these programs. In addi- 
tion to the ets staff, a group of nation- 
ally known experts provided advice 
throughout the course of the project. 
On the basis of the project report, the 
MIS 13 is now implementing plans for 
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evaluating driver education and train- 
ing programs. The research should he 
of interest to those concerned with 
similar problems of practical, short- 
term education, as well as those in- 
terested in the application of systems 
analysis to social problems. PK-68-7, 
PR-69-1. 

Evaluation of a Summer Reading 
Institute. 

MICHAEL ROSEN FELD 

During l he summer of 1968, the Model 
School Division (msd) of Washington, 
D. C. conducted an institute in begin- 
ning reading for teachers in kinder- 
garten through the third grade. The 
purpose of the institute was to improve 
reading instruction by training teachers 
in several methods. Educational Test- 
ing Service was asked to help msp per- 
sonnel develop formal objectives for 
the institute, a design for evaluative 
research, and tests tailored to the re- 
search need. After developing objec- 
tives, a questionnaire was prepared 
and administered to 69 teachers at the 
end of the six-week training session. 
Questionnaire data indicated a ma- 
jority of participants felt they bad 
learned quite a bit about m cl hods of 
teaching reading, fell the institute was 
relevant to their needs, planned to put 
what they had learned into action, and 
generally liked the way the institute 



was conducted. The research should be 
of interest to teachers and researchers 
in reading instruction. 

Matrix Item Sampling. 

LEONARD S. CAHEN 

Belli tester and ieslcc arc becoming 
sensitive lo the dangers of ovcrlesting. 
One promising technique for using 
available lime more efficiently is known 
as item-sampling. For example, group 
means of test scores arc customarily 
obtained by processing the score tola Is 
of all individuals in whatever the 
group may be — a class, a school, a 
subject- in a Her grouping across the 
nation. Valid group means, however, 
may also be obtained either from the 
scores of a limited sample of the total 
number of students or by sampling the 
responses to single items within the 
total lest. This study is exploring ilcm- 
sampling techniques with high school 
students. Indications arc that the 
methods being used arc efficient for 
estimating school means for ninth grade 
students, and the approach is also 
being tried with twelfth grade students. 
An account of this study, co-authored 
with Thomas A. Tern berg and Waller 
Zwirner, will appear in Educational and 
Psych ol ogi ca l M ca su ran eti /, Spring, 
1970. The research should be of inter- 
est to educators, educational research- 
ers, and evaluators. MICH HlJ. 
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Strong Tru e-Sco re Theory. 

FREDERIC M. LORD, MARILYN S. 
WINCERSKY, MARTHA STOCKING 

How to make inferences about an ex- 
aminee’s ability from his lest scores is 
a traditional, persisting problem t fiat 
calls for persisting research. This study 
found that a mathematical model for 
relating what is known as the true 
score to the observed score fits the data 
very well and successfully predicts 
observable phenomena. The model can 
also be used to fit observed-score fre- 
quency distributions. It assumes that 
for a fixed true score, the observed 
score has a compound binomial dis- 
tribution. The research should be of 
interest to psychomctricians and statis- 
ticians. Its use in education is for ob- 
taining test norms when the entire test 
cannot be administered to a nationally 
representative sample. ONR. RB-68-8. 
RM-69-2. RM-69-4. 

Project Mirkwood. 

FREDERIC M. LORD, MARTHA STOCKING 

A method of testing that has been 
arousing wide interest involves the 
restriction of guessing. For example, 
in this project the examinee is told not 
to guess unless he thinks he has a 50-50 
chance of being right. The goal is to 
see whether it is possible to increase 
the amount of information obtained 
from a multiple-choice test by restrict- 
ing guessing in this fashion. Two find- 
ings were: (1) theoretical computations 
show that this is indeed possible, but 
(2) in practice, the actual results did 
not yield better measurement. The 
research should be of interest to mental 
test theorists and test constructors, 
and is relevant to the study of scoring 
procedures based on confidence weight- 
ings. As for the title, fans of J. R, R. 
Tolkien will recognize a familiar name: 
Mirkwood. Searching for a meaningful 
relation to the project itself, however, 
will';prove a fruitless guessing game. 
The fact is Dr. Lord and Miss Stocking 
happened to be reading the same book 
at the same time, were confronted with 
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the need for a project title, and oil im- 
pulse decided to commemorate their 
enjoyment of Tolkien. 

Tailored Testing Theory. 

FREDERIC At. LORD, MARTHA STOCKING 

The successful experimental use of 
computers for instruction implies that 
they may some day be extensively used 
for testing. Of the types of tests which 
seem promising, tailored tests would be 
most easily administered by computer. 
A tailored test is one in which an ex- 
aminee’s response to each question 
determines which of possibly several 
choices of questions will be given to 
him next in the testing sequence. A 
number of empirical studies of tailored 
tests have been made by the Army, at 
ets, and elsewhere. However, the pur- 
pose of this study was to sec to what 
extent the knowledge gained from 
empirical testing can be generalized 
through the use of theory. It found 
that the effectiveness of the various 
tailored testing procedures can actually 
be predicted using the appropriate 
mental test theory. It also found that 
tailored tests provide more information 
than standard tests about an examinee 
at extreme ability levels — that is, either 
high or low proficiency. This is partic- 
ularly relevant to educational testing 
in that the more information that can 
be obtained from testing, the easier it 
will be to predict the probable future 
course of an examinee’s education. 
The research should be of interest to 
mental test theorists, test constructors, 
and those interested in computerized 
testing. ONR. RB-68-38. RB-69-18. RB- 
69-63. 

Statistical Theories of 
Mental Test Scores. 

MELVIN R. NOVICK, FREDERIC M. LORD 

More than 15 years have passed since 
the publication of Theory of Mental 
Tests by Harold Gulliksen of ets. Now a 
new synthesis of the field has been pre- 
pared by Drs. Novick and Lord. Their 
text, Statistical Theories of Mental Test 




Scores , was published in 1968. The 
book gives precise statements of the 
assumptions underlying and implica- 
tions deriving from a number of test 
theory models. It also attempts an 
integration of these models into a very 
general theory of latent traits. Four 
chapters on latent trait theory and the 
logistic sequence model arc by Allan 
Birnbaum of New York University. The 
project’s present task is to review all 
new work in test theory and integrate 
it into the structure of this text for 
revised editions. This research should 
be of interest to psychomctricians and 
test theorists. ONR. 

Statistical Models of Mental Tests. 
MELVIN R. NOVICK 

Most people think of psychological re- 
search as being a matter of testing 
people or animals and drawing con- 
clusions from what happens. These 
conclusions then become the raw ma- 
terial out of which theories are con- 
structed. Another approach to psycho- 
logical truth, however, is that of seek- 
ing certain basic, seemingly self- 
evident statements about reality upon 
which one can base theories. These 
basic statements are known as axioms, 
and the mathematical psychologist — 
who in addition to 100 years of scien- 
tific psychology has more than 2,500 
years of scientific mathematics at his 
disposal — is one of few who are 
equipped to seek them.' This study is a 
search for axioms to which all modern 
mental testing theory might be related 
and upon which a new general theory 
of testing might be constructed. Sev- 
eral papers in professional journals 
cover work on the project to date. The 
research should be of interest to test- 
ing theoreticians. ONR. NlCHHD. 

Statistical Methods in Personnel 
Selection , Evaluation , and Guidance. 
MELVIN R. NOVICK 

Tests have been very useful for match- 
ing applicants’ skills and interests with 
the needs of particular jobs, in evaluat- 



ing an employee’s performance on the 
job, as an aid in job counseling, and in 
selecting students. A major synthesis 
of selection methods bearing on this 
area was accomplished by R. L. 
Thorndike soon after World War If. 
Since then, however, new develop- 
ments in prediction methods have 
brought on the need for a new synthe- 
sis of the underlying testing theory. 
But before this can happen, certain 
problems must he solved. One is the 
problem of correcting for a limited 
sample — that is, when only a small 
percentage of a group is selected for 
testing, the findings will produce 
rather grave distortions unless one 
uses dependable means of statistical 
manipulation before using the data to 
predict the nature or actions of the 
group as a whole. Another problem is 
to^esolvc certain statistical difficulties 
involved in selecting the right group of 
variables for prediction in future 
samples. Publications covering several 
phases of the work to date are available 
through ETS and other sources. The 
research should be of interest to those 
concerned with test theory and devel- 
oping computer programs that will 
facilitate selecting, evaluating, and 
counseling students and employees. 
ONR. 

Bayesian Inference. 

MELVIN R. NOV1CK 

A satisfactory solution to the long- 
standing problem of specifying prior 
distributions over the states of nature 
required for Bayesian analysis is 

needed. The purpose of this research is 
to seek such a solution and also to 
explicate a dual credibility-frequency 
theory of probability. To date, the prior 
distributions derived from the proposed 
indifference procedures have been 

found to be in substantial agreement 
with some of those previously accepted 
on essentially intuitive bases. How- 

ever, the present system is often able 
to "explain” differences that have 

arisen among earlier specifications. The 
research is covered in detail in the 
Journal of the American Statistical Asso- 
ciation (December and March, 1965) 
and the Journal of the Royal Statistical 
Society (1968). NICHHD. 
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A General Method for Analysis of 
Covariance Structures. 

KARL JORESKOG 

Selecting and tailoring statistical tech- 
niques to fit the peculiarities of various 
practical problems can be not only 
time-consuming hut also a bewildering 
process. Hence, seeking generally ap- 
plicable solutions for a multitude of 
problems is a matter of urgency in re- 
search. This study sought to develop a 
statistical model, and an associated 
method of data analysis, so general 
that it could be used to handle many 
different kinds of data and problems in 
the behavioral sciences. The most no- 
table finding was that the technique 
under investigation can be successfully 
used to perform: 1) analysis of sets of 
congeneric tests; 2) first- and second- 
order factor analysis; 3) analysis of 
simplexes and circumplexes; 4) analy- 
sis of multi-method-multitrait data; 5) 
analysis of multi-test-multioceasion 
data; 6) analysis of linear structural re- 
lationships; 7) mixed and random 
effects anova; and 8) manova and 
other kinds of advanced analysis. Be- 
sides its generality and flexibility, the 
method is unusual within this sphere. 
The research should be of interest to 
data analysts in the behavioral sciences 
and to statisticians. A condensed re- 
port will appear in Biometrika. RB-69- 
46. rb-69-47. rb-69-62. nsf. 



A General Theory of Oblique Factor 
Rotation. 

WALTER KRISTOF 

One of the most challenging aspects of 
factor analysis is the matter of rotation 
and interpretation. Within this general 
area a specific problem ofimportanee is 
how to state the necessary and suffi- 
cient conditions for rotating factor 
patterns and factor structures to each 
other with a high degree of fit. This 
study states these conditions in terms 
of theory of eigenvectors and eigen- 
values.. It also found that fit can often 
be improved through a slight change of 
the target matrix. The procedure can 
lead to improvements jn comparing 
results from factor analyses, and should 
be of interest to both theoretical and 
practical factor analysts. NICHHD. 
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On Proportional Profiles in 
Factor Analysis. 

WALTER KRISTOF 

Questions of existence, ways of trans- 
formation, and goodness of fit criteria 
for proportional factor profiles were 
explored by this study. By placing spe- 
cial emphasis on symmetrical goodness 
of fit criteria, it found that necessary 
and sufficient conditions for the exist- 
ence of proportional factor profiles can 
he established. It also found ways of 
reducing the problem of proportional 
factor patterns to the more easily manip- 
ulated problem of proportional factor 
projilcs. The study revises and comple- 
ments basic work on an important as- 
pect of factor analysis, and should be 
of interest to factor analysts and psy- 
cho metricians. NICHHD. 

Statistical Notes on Reliability 
Estimation. 

WALTER KRISTOF 

When a test has been split into any two 
parts under normality assumptions, ob- 
taining a maximum-likelihood estima- 
tion of test reliability (coefficient alpha) 
becomes a problem. Using the maxi- 
mum likelihood method, this study 
identifies the estimator. It also gives a 
statistical test of hypotheses concern- 
ing the parameter that establishes 
confidence intervals. It is chiefly rele- 
vant to other research in this area by 
generalizing and closing gaps in the 
research. This study research should 
be of interest to test theorists, test 
users, and statisticians. RB-69-25. 
NICHHD. 

Structural Properties and Measurement 
Theory of Certain Sets Admitting a 
Concatenation Operation. 

WALTER KRISTOF 

Explorations in advanced measurement 
theory have raised questions of the ex- 
istence and uniqueness of scales for 
certain continuous and ordered sets 
when a concatenation operation for 
pairs of objects is defined which satis- 
fies certain requirements. This study 
found that scales of this nature can be 
constructed and are unique up to posi- 
tive linear transformations. It also 
developed a number of theorems con- 
cerning reflexivity and commutativity 
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of the concatenation operation. The 
findings complement other theories, 
and should he of interest to measure- 
ment theorists, researchers in psycho- 
physics, and mathematicians. British 
Journal of Mathematical and Statistical 
Psychology , 1968, 21, 201-229. 
NICHHD. 

A Theorem on the Trace of Certain 
Matrix Products and Some 
Applications. 

WALTER K HIST OF 

A problem in the use of matrix theory 
is the stating of attainable upper and 
lower limits for the trace of certain 
matrix products. This study found a 
solution for the problem by stating 
these limits as a theorem, which was 
proved by induction with an em- 
phasis on canonical decompositions of 
matrices. The theorem can be used to 
solve various problems in psychomet- 
rics when the trace of matrices is in- 
volved and should be of interest to 
psychometricians, mathematicians, and 
statisticians. RB -69-21. Journal of Math- 
ematical Psychology (In press). 
NICHHD. 

Estimation of True Score and Error 
Variance for Tests under Various 
Equivalence Assumptions. 

WALTER KRISTOF 

Another problem in the field of mental 
tbsFth eory~ lFHotvtolJevel op'maximu m- 
likclihood estimators of triv? score 
variance and error variance for mental 
tests under different hypotheses of 
equivalent measurements. Using a 
measurement model involving classical 
test theory in conjunction with dis- 
tributional assumptions, this study 
established these estimators and some 
of their statistical properties. It also 
developed a statistical criterion for 
tau-equivalent measurements. The re- 
search should be of interest to test 
theorists, test users, and statisticians. 
RB-68-57. Psycho met rika , December, 
1969. NICHHD. 

On the Parallelization of Trace Lines 
for a Certain Test Model. 

WALTER KRISTOF 

Whether parallelization of a set of 
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trace lines is possible for a certain test 
model is a problem for the measure- 
ment theorist. Using the theory of 
functional equations, this study found 
that parallelization is possible and 
essentially unique if — and only if — 
all item characteristic functions are 
powers of each other. It also found 
that upon transformation all item 
characteristic functions assume a 
unique functional form regardless of 
their initial form. The findings shed 
light on the notion of latent continua 
and on the possible proper form of 
characteristic functions. The research 
should be of interest to test theorists. 
RB-68-56. NICHHD. 



On the Sampling Theory of 
Reliability Estima t i on . 

WALTER KRISTOF 

This study sought to develop a statis- 
tical test for coefficient alpha — and 
hence reliability — under the situation 
of normality assumptions when a men- 
tal test has been split into any two 
parts. While this is customarily a dif- 
ficult problem, by a certain transforma- 
tion of variables the problem was re- 
duced to more workable and familiar 
proportions. The end results of the 
study were that a strict test for coeffi- 
cient alpha for any sample size was 
developed, and confidence intervals for 
the parameters were established. The 
research should be of interest to test 
theorists, test users, and psycho- 
metricians. RB-69-36. Accepted fir 
publication by the Journal of Mathe- 
matical Psychology. ONR. 



On Metric Multidimensional Unfolding. 
PETER SCHONEMANN 

The problem of locating two sets of 
points in a joint space when you are 
given the Euclidean distances between 
elements from distinct sets was solved 
algebraically in this study. For error 
free data the solution is exact; for 
fallible data it has least squares proper- 
ties. A computer program was written 
to carry out the necessary computa- 
tions. Several numerical illustrations 
are given in the study to illustrate the 
feasibility of using this procedure for 
the analysis of nonmetric data. The 



research should he of interest to 
psychometricians. Psychomelrika (in 
press) . 

Scaling a Simplex Symmetrically. 

PETER SCHONEMANN 

The purpose of this study was to devise 
a method for estimating the latent pa- 
rameters of simplex matrices that does 
not depend on the order of the mani- 
fest variables. A method for scaling a 
perfect simplex is suggested which is 
based on a procedure for scaling a set 
of points from their pairwise distances, 
thus retaining the symmetry of the 
data matrix. The approach was extend- 
ed to an iterative algorithm for scaling 
a quasi-simplex, and a FORTRAN iv pro- 
gram for scaling both types of simplex 
matrices was written. Among the find- 
ings were certain indeterminacies in 
the quasi-simplex model, one of which 
does not seem to have received much 
attention so far, although it may con- 
strict the practical utility of the more 
general model. On applying the pro- 
gram to a number of data sets from the 
literature, it was found that the fit for 
a quasi-simplex was usually satisfac- 
tory, while the fit for a perfect simplex 
was usually poor. The research should 
be of interest to psychometricians. 
RB-68-31. Psychometrika , March 1970. 

Fitting One Matrix to Another Under 
Choice of a Central Dilation and a 
Rigid Motion. 

PETER SCHONEMANN 

The purpose of this study was to de- 
velop a least squares procedure to com- 
pare results obtained with nonmetric 
scaling techniques across samples, or 
to compare such results with those 
obtained by conventional factor anal- 
ysis on the same sample. A least 
squares method was derived for fitting 
a given matrix A to another given 
matrix B under choice of an unknown 
rotation, an unknown translation, and 
an unknown central dilation. The 
method was programmed for the com- 
puter and applied to several data sets, 
both real and artificial. The research 
should be of interest to psychometri- 
cians. RB-69-78. Psychometrika (in 
press). 
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On Two-Sided Orthogonal Procrustes 
Problems t 

PETER SCIIONEMANN 

Earlier work of Dr. Schoiicmaiin dealt 
with a least squares solution to the 
problem of finding an orthogonal 
matrix T in B = TAT = E, given A,B, 
both symmetric, which minimizes trE’E. 
It was hoped that the solution of this 
problem might prove useful ill solving 
another problem: Given A,B, both 
symmetric, find a permutation matrix 
P in B = P’AP + E, which minimizes 
trE’E. One difficulty with this approach 
is that the solution matrix T of the con- 
tinuous problem is not unique. Instead, 
a family of 2p (if A,B arc of order pxp) 
solution matrices exist, all of which 
reduce the loss function to the same 
minimum. The present study was con- 
cerned with finding practical means 
for removing this indeterminacy to 
make the suggested method useful for 
the intended purpose. The attempt, 
however, proved unsuccessful. NIMH. 

Vi ariance Ana lysis System — M A NO VA . 

CHARLES E. IIALL 

As knowledge increases by leaps and 
bounds so grows tiie need to expand 
and simplify our methods of processing 
and making use of it. The aim of this 
project is to increase the capacity for 
statistical processing of information by 
developing a general system for cor- 
relation analysis, .factor ..analysis, and 
analysis of variance and covariance so 
as to eliminate separate computer pro- 
grams. In moving toward this objective, 
some general programs for statistical 
processes are being studied at ets: 
special attention has been given to two 
multivariate analysis of variance pro- 
grams: MANOvA, by Elliot Cramer, and 
MULTIVARIANCE, by Jeremy Finn. In 
addition, an improved method for com- 
puting orthogonal polynomial coeffi- 
cients has been devised, and efficient 
methods for matrix inversion are being 
explored. The research should be of 
interest to psychometricians and statis- 
ticians working with researchers. 

Advanced Moderator Variable Study . 
DONALD A. ROCK, FRANKLIN R. EVANS 

A way of increasing the predictive 
validity of tests is to identify, and then 
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construct tests to make use of, modera- 
tors as well as predictor variables. For 
example, where a high score on a test of 
quantitative ability might to a certain 
degree predict math grades in college, 
this predictability might be increased 
if one knows whether the candidate 
has a parent who wants to see him 
succeed — a variable which in this hypo- 
thetical instance v r ouId moderate the 
usefulness of the predictor variable in 
estimating probable math performance. 
This study is investigating the moderat- 
ing effects of certain background vari- 
ables on the prediction of law school 
grades. It is also examining whether a 
number of nev r tests would act as 
moderators or as predictors. A measure 
to assess certain personality traits is 
being constructed. Earlier a battery of 
tests was assembled and pretested for 
final administration during the fall of 
1969. Results of this testing will be 
used in constructing a final battery. 
The research is for the Law School 
Admission Test Council. 

Gauss-Scidel Computing Procedures 
for Some Methods of Factor Analysis. 
MICHAEL BROWNE 

The purpose of this study v r as to use 
Gauss-Seidel computing procedures to 
obtain the following estimates of the 
factor matrix: Type I, maximum likeli- 
hood; Type II, alpha; Type III, least 
squares with fixed weights,* Type IA, 
weighted least squares using residual 
variances as weights; and type IIA, 
weighted least squares using com- 
mon variances as weights. Among the 
findings, the study suggests modifica- 
tions in Gauss-Seidel computing proce- 
dures in obtaining Type I and Type III 
solutions. Procedures for solving the 
nonlinear equations involved in Type 
I A and Type IIA solutions were de- 
veloped. Subroutines w f erc also pre- 
pared for each of the five solutions. 
The results generally indicate that the 
procedures are effective' with a number 
of empirical correlation matrices, in- 
cluding two non-Gramian tetrachoric 
correlation matrices. However, the 
Type I solution should not be com- 
puted if the correlation matrix is non- 
Gramian. The research should be of 
interest to psychometricians and test 
developers. RB-68-61. 




Precision of Prediction. 

MICHAEL BROWNE 

In psychology and psychometrics, 
much effort goes into developing 
theories that can be used to predict 
behavioral and other outcomes. The 
task is crucial not only because it is 
useful to be able to predict what people 
will do under certain circumstances, 
but also because theories serve general- 
ly to establish firm ground within the 
great open reaches of psychological 
space. During the last 20 years, the 
research psychologist’s powers of pre- 
diction have been tremendously in- 
creased by a new statistical and com- 
puter methodology that allows him to 
take into account many rather than 
few variables in his research explora- 
tions. This new power, however, has 
led him to confront an important ques- 
tion: How far may one go in taking 
predictor variables into account before 
one reaches a point of diminishing re- 
turn? Tin's is a question of trade-offs, 
perhaps more familiar as: Will one 
hundred dollars’ worth of additional 
effort produce two hundred or only 
two dollars’ worth of benefit? The ques- 
tion was explored mathematically and 
also by programming a computer to 
many kinds of trade-off situations. The 
optimum number of predictor variables 
was found to depend on sample size. A 
formula, which should aid psychol- 
ogists in gaining precision of predic- 
tion, has been developed to express 
this relationship. NICHHD. RB-69-69. 

Least Squares Matrix Factorization 
and Multidimensional Scaling. 

CORDON G. BECHTEL 

A problem that might at first glance 
seem rather remote from everyday life 
is that of deriving multidimensional 
scales from the choices individuals 
make among stimuli. The major finding 
in this study was a theoretical point in- 
volved in the way in which the least 
squares matrix factorization method 
will provide the key to solving this 
problem. However, an application re- 
ported in the study begins to suggest 
its generality. The dimensions of 
"liberalism-conservatism” and "polit- 
ical audacity”* were found when this 
method was applied to data collected 
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on political preferences. The research 
should be of interest to psychomctri- 
eians, psychologists, economists, sociol- 
ogists, market researchers, political 
scientists, opinion and attitude polling 
organizations, and some educators. It 
provides a method whereby researchers 
in the above fields can discover the 
dimensions underlying whatever kinds 
of choice behavior they may wish to 
study. For example, in education the 
study may be useful in discovering the 
dimensions that underlie social inter- 
action in the classroom, or the dimen- 
sions underlying student choices among 
courses, vocations, other students, and 
so on. RB-69-73. 



Defining Groups 
iti Multivariate Space 
BARY G. WINGERSKY 

In arriving at many practical decisions 
involving large numbers of people, it 
is necessary to separate them into 
categories according to test scores. For 
example, test-takers can be separated 
into the familiar pass or fail categories 
according to the results of a quiz re- 
lating to a particular ability. There arc 
far more complex situations, however, 
where the scores of individuals must be 
grouped into several categories accord- 
ing to responses varying along numer- 
ous personality, background, or cogni- 



tive ability dimensions. This study has 
developed a way of identifying useful 
categories within a body of data and a 
procedure for manipulating the data to 
make these structures more evident. 
Moreover, a computer program for in- 
dicating whether such structures with- 
in a body of data relate to one main 
grouping, or to many groupings, has 
been completed. The procedure is being 
tested with personality inventory scores 
of 602 college boys and 679 college 
girls, and programs based on the proce- 
dure should eventually be available for 
general use. The research should be of 
interest to test developers and research 
data processors. 
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Statistical Adjustments When 
Comparing Preexisting Groups. 

FREDERIC M. LORD 

It is common to use analysis of co- 
variance to "adjust” data so that pre- 
formed groups (e.g., racial groups) can 
be compared on final achievement with 
their initial differences supposedly re- 
moved. This study explored the use of 
this approach in correcting for pre- 
■- existing differenees between preformed 
groups, and found that analysis of co- 
variance is often clearly inadequate. 
The research should be of interest to 
anyone who wishes to correct for 
initial differences. It is particularly 
relevant to comparisons of racial or 
economic groups on ability to learn. 
RB-68-67. Psychological Bulletin , 1969, 
72, 336-337. 

Learning . 

HAROLD GULLIKSEN 

An appealing feature of mathematical 
learning theory is that it makes it pos- 
sible to study the learning process in 
terms of the precision offered by, for 
example, the plotting of learning task 
performance curves on a graph. A dif- 
ficulty, however, is that there is so 
much variation between individuals 
and between groups in learning capac- 



ity that much of the advantage of the 
mathematical learning theory and of 
curve-fitting statistical methods is lost 
through the impreeisions of the usual 
multi-organism comparisons. For this 
reason researchers have become greatly 
intrigued by the possibilities of the 
split-brain technique, whereby it is 
theoretically possible to compare learn- 
ing performance curves not between 
two individuals or groups, but within 
or between the two' halves of the same 
brain. The assumption has been that 
right and left brain learning is identical. 
This research, however, seeks to de- 
termine whether this is actually true. 
The parameter estimation is still pro- 
ceeding, but to date it appears that 
right and left brain learning are not 
identical. One noteworthy contribution 
has been a new parameter estimation 
procedure developed by Dr. Gulliksen’s 
student, James Ramsay. The research 
should be of interest to researchers 
concerned with mathematical learning 
models, split-brain work, and para- 
meter estimation methods. 

Independent Activities Questionnaire. 
FRANKLIN R. EVANS 

Most formal testing purposely dis- 
regards the past in order to concen- 



trate on seeing what a person can 
actually do at one present point in 
time. One reason for the popularity of 
this approach is that it lends itself to 
rather clean-cut and efficient process- 
ing, and the past is not so easily 
quantified. However, there is much to 
be said for an approach that attempts to 
quantify past performance by viewing 
it as the accumulation of real life 
achievements. Such an instrument is 
the Independent -Activities Question- 
naire (iaq), which quantifies reports 
of a great variety of high-level achieve- 
ments in activities that are self-initiated 
by students during their high school 
years. The iaq, for example, provides 
a way of quantifying some possibly 
important indicators of adult potential 
such as high school activities — being a 
class president, winning an art prize, or 
building a successful hot rod ear. To 
date iaq has been used ehiefiy as a 
criterion measure for creativity studies. 
However, continuing research and 
evaluation of the instrument indicates 
many other potential uses. New forms 
have been developed for use in research 
into the creative potentials of college 
and graduate students. The approach 
also seems to have developmental pos- 
sibilities for assessing the potential of 
black students, or students from any 



other cultural background where poten- 
tial for "success” may be better re- 
flected by performance in their envi- 
ronment than in performance on a for- 
mal test. The research should be of 
interest to guidance and admissions 
personnel at all educational levels, as 
well as researchers in creativity and 
black and urban problem studies. 

Longitudinal Study of Early Predictors 
of Creative Achievements . 

FRANKLIN R. EVANS 

This study is investigating whether 
measures of student ability, interest, 
and achievement in grades 7, 9, 11, 
and 12 can predict iaq scores at the end 
of grade 12. That is, this is an instance 
of the use of the experimental IAQ 
measure as a criterion of creativity. 
Relatively complete data on over 1,000 
students lead to the following conclu- 
sions to date. The best predictors of 
present and future creative achieve- 
ment were measures of past achieve- 
ment. Seventh grade academic skills 
seem to correlate significantly with the 
criteria of creativity under study. The 
combination of past achievements and 
academic skills had correlations rang- 
ing between .40 and .50 with iaq scores. 
And the particular criterion area — for 
example, creativity in science versus 
creativity in art — and the sex of the 
student seemed to be the chief mod- 
-erato r s-of-the~re]ationsliips~found~in- 
this study. The research should be of 
interest to researchers in creativity 
and developers of noncognitive ability 
measures. 

Models for Measurement and Learning. 
ERIC HOLMAN 

Two lines of research were pursued in 
this study: (1) the application of con- 
joint measurement to asymptotic learn- 
ing data, and (2) the investigation of 
sequential properties of two-choicc 
learning. Among the findings: Although 
there are exceptions that warrant fur- 
ther investigation, the conjoint meas- 
urement axioms seem to be satisfied to 
a first approximation by most of the 
available learning data. Consequently, 
the asymptotic response probabilities 
observed in simple learning experi- 
ments can be ordered according to the 
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product of two functions in the case 
of classical conditioning, and three 
functions in the case of instrumental 
conditioning. As for the second line of 
investigation: When used to dis- 

tinguish between learning models, most 
sequential statistics contain relatively 
few degrees of freedom. Moreover, and 
rather surprisingly, these sequential 
statistics tend to reflect the total dis- 
tribution of response probabilities over 
all trials, rather than trial-by-trial 
changes in response probabilities. The 
research should be of interest to re- 
searchers in psychometrics and learn- 
ing theory. 

Error Choice Study. 

THOMAS S. BARROWS 

One of the most difficult problems in 
measuring attitudes is how to construct 
measures that will uncover what the 
person really feels or believes, rather 
than what he senses may be socially 
acceptable. This study is exploring the 
use of the error choice technique in 
measuring attitudes toward Negroes. 
The approach uses an item format 
similar to that of standard, factual 
multiple-choice questions; however, 
with the error choice technique there 
is no correct answer per se. Each choice 
for any multiple-choice question is de- 
signed to reflect varying degrees of 
attitude. The study should be of in- 
_t e rest— to_ p sycholog ists s tudying atti- 
tude measurement, and to psycho- 
metricians studying characteristics of 
various item types. It should be par- 
ticularly relevant to the interests of 
those concerned with developing more 
dependable ways of measuring attitudes 
toward Negroes both in educational 
settings and more generally. 

Cross-Sectional vs. Longitudinal Results. 
THOMAS L. HILTON, CATHLEEN PATRICK 

The ETS Growth Study has a data bank 
of the results from repeated testings of 
32,000 students in 17 U.S. cities from 
1961 to 1967. A difficulty in making use 
of this rare collection of information 
has been the problem of relating longi- 
tudinal data of this nature to cross- 
sectional study results — so that one 
may safely generalize. Longitudinal 
data, for example, are particularly val- 




uable because they are compiled on the 
same individuals over an extended 
period of time. Such data are gathered, 
however, from a limited subsample of 
the population sampled by the cross- 
sectional approach. This study sought 
to determine relationships between the 
two research methods by comparing 
mean achievement test scores for 
matched longitudinal, unmatched longi- 
tudinal, and cross-sectional data. It 
found that matched longitudinal data 
yielded significantly higher means than 
either unmatched longitudinal or cross- 
sectional data. It also found that a 
school’s drop-out rate was highly re- 
lated to the fifth grade discrepancy in 
mean scores between cross-sectional 
and matched longitudinal data (r = 
.85). The study should be of interest to 
researchers studying individual devel- 
opment and evaluating school effects, 
and to school administrators and policy 
makers attempting to interpret test 
results of groups of students. 

Review of Literature on Self Fulfilling 
Prophecy. 

WILLIAM E. COFFMAN, MARY E. PARRY 

Sociologist Robert Merton coined the 
phrase "self-fulfilling prophecy” for a 
phenomenon that has been noted in 
many contexts — the strange fact that 
quite often things happen according 
to one’s expectations. The self-ful- 
, filling prophecy has been discerned 
at work in bank failures, Bowling 
games, warfare, and, within education, 
in low achievement by students in 
apparent response to low expectations 
of teachers. Of major concern to re- 
searchers are the possible effects of 
expectation in distorting research find- 
ings. This study involved a search of 
the literature, mainly in the fields of 
psychology and education, seeking to 
identify problems involving experi- 
menter bias in research, as well as 
ways to control for, or prevent, such 
bias. The study identifies numerous 
instances of biasing expectations on 
the part of the research investigator 
and his subjects (the Hawthorne effect, 
for example) as well as numerous con- 
trols. Since the problem occurs in 
research of almost every type, this 
study should be of interest to research- 
ers in all areas. 
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Decision Theory' Approach to 
Multi-Stage Testing. 

DONALD A. ROCK, ROBERT L. LINN, 

T. ANNE CLEARY 

This study has somewhat the same aim 
as the study of programmed tests — to 
reduce testing time by applying sequen- 
tial branching techniques. However, 
there is an important difference. 
Rather than branching to fit the indi- 
vidual with each question — as, in a 
sense, the programmed test approach 
does — in this case, the individual is 
presented with a choice of many short 
tests, each of which measures a dif- 
ferent aspect or level of his abilities. 
The choice of the particular set of tests 
that best fits him is determined by a 
sequence of questions — his answers 
determine which short tests he should 
take, and which he shouldn’t, as well as 
how many short tests of a particular type 
he should take before his ability in any 
one area is accurately assessed. Prog- 
ress has been made in developing classi- 
fication methods and computer tech- 
niques. The research should be of in- 
terest to test development specialists 
and computer scientists. RB-68-11. 

An Investigation of Student Test-Taking 
Behavior. 

DEAN W. SEIDEL, SCARVIA B. ANDERSON, 
ARLEEN S. BARRON 

An early step in test development"^ - 
pretesting to see whether the test meas- 
ures what it is supposed to, and to find 
out how it may be improved. Statistical 
data (such as p-values and discrimina- 
tion indices) are generally used to 
evaluate pretesting results. However, 
a persistent question is whether over- 
reliance on statistical measures may 
blind test developers to other important 
clues to test relevance and usefulness. 
This study sought to find out: (1) 
whether it is possible to increase the 
value of pretesting operations by in- 
cluding observational as well as statis- 
tical data, (2) whether children of dif- 
fering social classes show observable 
differences in test-taking behavior, and 
(3) whether other classroom charac- 
teristics are test relevant. The method 
is of particular interest in that a 
"natural” observer (the child’s regular 
teacher) and an external observer (an 
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E*rs researcher) observed how students 
of different social classes (high or low 
SES) responded to various test items. 
Forty third-grade, 82 seventh-grade, 
and 92 eleventh-grade classes, and 
more than 2,900 different items were 
involved. The data are being analyzed. 
When finished, the study should be of 
considerable interest to test developers 
and to all those concerned with evalua- 
tion that will capture the interest — as 
well as more fairly evaluate — children 
of all backgrounds. 

Cognitive and Affective Dimensions of 
Differential Achievement on 
Open- and Closed-Book 
Achievement Tests. 

GARY L. MARCO 

Many questions confront a teacher 
when he weighs the considerations for 
giving an open-book versus a closed- 
book exam. This study examined these 
three: Will taking an open-book test 
result in higher achievement scores? 
Will it result in lower test anxiety? 
And what cognitive and personality 
variables are related to open-book 
achievement testing? The subjects were 
164 college seniors. It was found that 
the open-book exam increased their 
achievement on knowledge items but 
not on application items. The open- 
book exam also seemed to decrease 
anxiety slightly. As for test-relevant 
abilitiesT-the-same-types-seemed-to-be- 
required for both open- and closed- 
book exams. The research should be of 
interest to teachers. It suggests they 
can use open-book exams to help re- 
duce anxiety without markedly affect- 
ing achievement. 

Goal-Oriented Teaching 
Exercises. 

DONALD M. MEDLEY 

Needs for better methods of training 
teachers and better means of measuring 
teachers’ on-the-job effectiveness have 
long been recognized. The aim of this 
project is to meet both needs, as well as 
to aid research. The approach is to 
obtain for analysis a standardized sam- 
ple of a teacher’s classroom behavior 
by means of the Goal-Oriented Teach- 
ing Exercise. This is a brief teaching 
unit, defined in terms of specified out- 



comes that can be measured by a test. 
A four-day unit on air pollution was 
developed. The unit Was used by 
teachers in eight junior high school 
general-science classes with both the 
teachers’ and the students’ behavior 
being recorded by audio and video tape 
recordings. These tapes were analyzed 
to see if ways of relating specific types 
of teacher behavior to definite evidence 
of pupil learning could be found. Re- 
sults strongly suggest that even when 
they teach the same unit, different 
teachers aim for and achieve different 
kinds of pupil learning. The project 
Was carried out in collaboration with 
R. A. Hill of Temple University. Its 
results should be of interest to teachers, 
administrators, and educational re- 
searchers. 

SCAT-STEP Factor Structure. 

KARL JORESKOG, GOSTA W. BERGLUND 

The fact that some of our abilities re- 
main fairly constant while others 
change as we grow older poses prob- 
lems for test developers. They must, 
for instance, gain an understanding of 
what may be happening to the under- 
lying factor structure of any series of 
tests that is to measure apparent 
growth in skills over a sequence of 
years. The purpose of this study is to 
investigate stability and change over 
time of the factor structure of two ETS 
tests designed~for use frohT'graTdeS~5~ 
through 11, the School and College 
Ability Tests and the Sequential Tests 
of Educational Progress. Data from the 
total Growth Study sample are being 
analyzed. The approach involves fitting 
of alternative factorial models to test 
scores obtained at grades 5, 7, 9, and 
11. Being taken into consideration are 
general factors across all tests, factors 
specific to individual tests across 
grades, and factors specific to particular 
grades. When completed, the research 
should be of interest to test developers 
and to primary and secondary school 
administrators and teachers. 

Differential Weighting of Item 
Distractors in Data Sufficiency' Items. 
THOMAS F. DONLON, GEORGE H. DUNTEMAN 
An important practical consideration 



TABLE 1 



Behaviors Recorded In The First Word 



Symbol 


Name 


Brief Description 


1. 


PNS 


Pupil Utterance 
Non-Substantive 


Pupil makes a statement or asks a 
question not related to substance 


2. 


PQU 


Pupil Question 
Substantive 


Pupil asks for substantive information 


3. 


PST 


Pupil Statement 
Substantive 


Pupil offers substantive information 


4. 


PRS 


Pupil Response 


Pupil responds directly to another pupil 
or indirectly to teacher 


5. 


PBST 


Problem-Structuring 

Statement 


Teacher raises a substantive question 
or sets a problem (without indicating 
who is to answer it) 


6. 


CVG 


Convergent Question 


Teacher asks pupil a question N 
which calls for one right answer 


7. 


ELI 


Elaborating 1 Question 


Teacher directs question to the same 
pupil who answered the question preceding it 


8. 


EL2 


Elaborating 2 Question 


Teacher directs question to pupil 

T.tV\ n c* A O V* O rtnv /4 /-» n /I n rt n ♦- Vl n nv*rkn «<4 -I «p» n*. a 




DVG 


Divergent: Question 


wiiuoc — dii a_w_g L ucucimb uii uic pi/eceQJLng one 

Teacher asks pupil a question to 
which moire than one answer may be 
acceptable or correct 



Teacher behavior is being measured by Donald Medley. The tables on this and 
the next page explain the symbols used in the rating form for classroom obser- 
vers, known as OScAR (Observation Schedule and Record Form). The poten- 
tial interest of these brief lists is that researchers find these observable bits of 
behavior particularly useful in assembling descriptions that appear to be 
relevant to selecting, training, and assessing the performance of teachers. (See 
Medley, Goal-Oriented Teaching Exercises.) 
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TABLE 2 



Behaviors Recorded In The Second Word 



Symbol 


Name 


Brief Description 


i. 


NOEV 


No Evaluation 


Teacher does not reply to pupil utterance 


2. 


CNSUP 


Considering-Supporting 


Teacher utterance with positive affect 


3. 


INFAP 


Inf orming -Approving 


Teacher gives information or positive 
feedback 


V- 4. 


DSCAC ;; : y) 


; Descr ibing -Acc ept ing 


Teacher accepts pupil response or makes 
statement not otherwise classifiable 


'y5>< 


}; D I REJ M ; 


Directing-Rejecting 


Teacher commands pupil to do something or 
gives neg a t iv e } f e edb a c k 


6. 




Rebu^ 


Teacher, utterance with negative affect 






.;Desi is ting v ,\ ■ ; fiv?-" 1 


Teacher commands pupil to stop doing 
something or ^refuses peraission 


^ .8'i; 




; Pr o c ;edur a Neu tra^ 

Non--Substantive Question 


Teacher asks- ^ question; hot qtterwise^ ' 

\ classifiablbjq ‘ 

o.;nor gives 'permission ?? r 


|§f?| 


* PR+r 


.■ 

^Pro c e'dur a l^P’o sij^iye^fe#^ 


Teacher | off ers pupil : choice ; of. action 
or gives permission /.r ‘ * ‘j$ k " ‘ , * ? 




ft 
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in test development is test efficiency, 
in the sense of gaining useful informa- 
tion per unit of testing time. That is, 
if everybody gets roughly the same 
score on an item it will be of little use, 
so the objective is to find questions 
that some can answer and some cannot. 
But then what about the case of the 
test-taker who knows some of the 
answer, but not all of it? Shouldn’t he 
gain some credit for this knowledge, 
rather than be simply ruled right or 
wrong? This study sought to find out 
whether a test of this type might be 
developed by using a scoring scheme 
that assigned different weightings to 
wrong answer options. That is, a par- 
tially correct answer would get some 
bit of credit more than a wholly wrong 
answer. It Was found that using the 
approach did not yield appreciable 
gains in useful variance; however, the 
method for assigning weights was par- 
tially successful, and the study revealed 
ways of possibly improving the method 
of weighting. 

The research should be of interest to 
psychometricians and test developers. 
CEEB. 



Bayesian Methods of Item Allocation. 
ROGER OWEN 

The purpose of this research is to use 
Bayesian methods to determine the 
most useful sequence or arrangement 
ofitems in a test. Two research bulletins 
describe the results. “A Bayesian Ap- 
proach to Tailored Testing” considers 
the sequential design and analysis of a 
test consisting of dichotomously scored 
items. “The Optimum Design, Using 
Prior Information, of an Examination 
for Inference about Items with a Nor- 
mal Additive Model” investigates the 
extent to which an examinee’s expected 
observed score (or true score) on an 
item depends on his ability and on the 
easiness of the item. The results will 
be of interest to test developers and 
psychometricians. KB-69-92. 

Estimation of Test W eights by the 
Subjective Utility Function. 

DONALD SCHWARTZ 

There is a need in applied psychological 
measurement for some simple method 



Computer Studies 



Exploratory Project on 
Adaptive Programming. 

ERNEST J. ANASTASIO 

In recent years, complex computer 
systems have been developed for a 
variety of educational uses. A number 
of weaknesses in these systems have 
become apparent, however, which seem 
solvable only through more research 
in computer simulation of human 
processes. Thus, a major goal of this 
project was to construct systems, in the 
form of computer programs, that would 
“behave rationally” by simulating the 
outcome or product of the perceptual 
and reasoning processes used by 
humans in problem-solving situations. 
Efforts to date have yielded three func- 
tioning programs, each with varying 
degrees of true adaptive capability. 
One is a game-playing program that 







competes against a human — the re- 
searcher attempts to outdo the com- 
puter playing the complex game of Go, 
for example. Another is a hypothesis 
testing program that demonstrates how 
the computer can be used cooperative- 
ly, rather than competitively, in inter- 
active problem solving. A third pro- 
gram, like the first, is also competitive, 
but in this instance the computer’s 
“playing ability” can be adjusted to 
any one of nine levels to provide a 
better match for the skills of its human 
opponent. So far, aside from the devel- 
opment of programs, it has become 
apparent that a central, and possibly 
key, requirement of adaptive program- 
ming, is the translation of human 
thought processes into the algorithmic 
and heuristic forms readily compatible 
with computer processing. The research 
should be of interest to computer- 




to determine optimal test weights for 
use in situations where validity studies 
are unfeasible for economic or other 
reasons. This study attempted to see if 
such weights could be estimated using 
subjective utility scale values in a 
judgment situation. The subjects are 
asked to judge whether or not people 
who have been selected by a particular 
test battery are “successful.” Since 
subjective utility scale values can be 
determined by a simple and inexpen- 
sive questionnaire, this method might 
provide an economical substitute for 
costly predictive validity studies. A 
group of candidates for promotion to 
Senior Civil Engineering Assistant were 
tested and evaluated. It was concluded 
that (1) a subjective utility function 
does exist over a finite series of crite- 
rion elements in a personnel selection 
problem and can be measured by scal- 
ing methods, (2) this utility function is 
a good approximation of the optimal 
test (beta) weights in an idealized 
setting, and (3) the practical applica- 
tion of this method of weighting tests 
requires the use of tests with high con- 
struct validity. 



assisted instruction specialists, cur- 
riculum designers, and computer scien- 
tists 1 . 

Computer Generation of Test Items. 

ERNEST J. ANASTASIO 

Considerable progress has been made 
by computer technicians and test spe- 
cialists in developing systems that 
make it possible to turn over to the 
computer much of the task of assem- 
bling test items (or questions) into tests. 
However, the items must have been 
previously classified and pretested. The 
general purpose of this study was to 
determine whether computer assist- 
ance was feasible in the preparation of 
test items. A more specific objective 
was to identify the properties of “good” 
test items for measuring verbal ability, 
and to develop rules for coding words 
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This is a portion of a program 
written in the snobol program- 
ming language that was used to 
generate spelling items in a com- 
puter-assisted item-writing project. 
The program systematically mis- 
spells words in order to create 
distractor items. (See Anastasio, 
Computer Generation of Test Items.) 
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and sentences so they can be manip- 
ulated by a computer. After a sys- 
tematic analysis of the nature of dis- 
crete verbal items — spelling and sen- 
tence completion items, for example — 
the project was able to show that the 
computer can carry out some of the 
less creative steps in item writing. It 
also concluded that systematic explora- 
tion of the item-writing process could 
make possible the computer generation 
of test items with prespecified proper- 
ties — that is, items that would require 
only minor editing be 1 ore preliminary 
field testing. Though the study uses 
rather well-known computer tech- 
niques, this was the first application to 
this particular educational problem. 
The research should be of interest to 
test developers, computer-assisted in- 
struction specialists, and computer 
scientists. TDM-68-1, TDM-69-1, Jour- 
nal of Educational Measurement, Vol. 6, 
No. 2, Summer 1969. 

Computer- Assisted Testing. 

ROBERT L. LINN, DONALD ROCK 

Using computer consoles for testing 
examinees could make possible a num- 
ber of improvements in testing pro- 
cedures. For example, it makes possible 
the tailoring of items and their sequenc- 
ing to the individual examinee. It also 
. permits the use of new t y pes of ques- 
tions that require an interactive ex- 
change between the computer and the 
examinee. This study is evaluating new 
testing procedures of this type, which 
would make use of the flexibilities 
offered by computer-assisted testing 
devices. Though the research is still in 
the data collection phase, the results 
could be useful to a number of ets test- 
ing programs. The research is also being 
related to research in mental test theory 
and in the areas of human problem 
solving and computer-assisted instruc- 
tion. It could lead to more efficient 
measurement, and provide a means for 
measuring dimensions not currently 
measured by paper and pencil tests — 
for example, problem solving strategies 
that might be important to the choice 
of instructional methods. A report 
appeared in Educational and Psychologi- 
cal Measurement , 1969, 24 , 184-145. 
CEEB. (T. A. Cleary, co-author.) 







A Computer Model of Everyday 
J J u m an Th in Jang. 

WILLIAM A. LEAF 

A use of the computer that has greatly 
intrigued researchers over the past 
decade has been the way it may he 
used to simulate human thinking 
processes. Much may be learned about 
human thinking if one can translate 
the various operations involved into a 
set of instructions to the computer, 
and then have the computer solve 
problems in roughly the same se- 
quences and with roughly the same 
results. This study used recent re- 
search and theorizing to outline a 
model of the processes people use in 
normal thinking. Specifically, the 
model was that which seemed to be 
used by a person in .maintaining a 
valid mental picture of the outside 
world and its various relationships to 
him. The model was written as a 
computer program (in a list-processing 
extension of PL-I) to force specifying 
the steps that are assumed or implicit 
and thus operationally vague in most 
formulations. After being coded, the 
model will he tested for the degree to 
which it can duplicate a real-life, prob- 
lem-solving situation. When com- 
pleted, the research should be of in- 
terest to those interested in computer 
simulation of human thinking proc- 
esses, or "artificial intelligence,” as 
-it-is -known, 



Multivariate Statistical Analysis. 

HARRY H. HARMAN 

One reason for the popularity of the 
computer among researchers is that it 
makes possible carrying out within 
minutes statistical analyses of data 
that would otherwise take weeks or 
months. However, in order to gain this 
dramatic advantage in time, it is neces- 
sary to plan for it in one’s research 
and to have a range of computer 
programs that offers some flexibility of 
choice. This project has concentrated 
on developing such a range of com- 
puter programs within the very broad 
area of multivariate statistical analysis. 
Particular emphasis has been placed 
on the development and adaptation of 
programs for studies that are still in 
relatively early, unstructured, probing 
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stages. A manual of scientific programs 
has been prepared to communicate the 
availability of these programs. It now 
contains about a dozen computer 
programs in the areas of multivariate 
statistical analysis and operations re- 
search, and additional programs are 
being included in the manual as they 
become available. The project should he 
of interest to all researchers making 
use of multivariate statistical analysis. 

Computer- Assisted Testing Symposium. 

HARRY If. HARMAN, CARL E. HELM, 

DAVID E. LOVE 

In the eruption of acronyms that char- 
acterize the computer revolution, two 
names have emerged from the educa- 
tional setting about which some con- 
fusion exists: C.AI, or computer-assisted 
instruction, and cat, or computer- 
assisted testing. Those working on in- 
struction find they are also involved 
in testing, and those working in testing 
find they arc also involved with instruc- 
tion. To explore the possibilities of a 
productive interaction between the 
two interests, and also to help shape 
long-term goals in this area for ets, a 
research symposium was convened at 
ets. For two days computer scientists 
from organizations throughout the 
country probed issues in the field and 
the proceedings were transcribed, 
edited, and have been published in 
-Computer- Assisted— Testing, availahl e 
through the ETS Office of Computation 
Sciences. Participants included Ernest 
Anastasio, A. G. Bayroff, Gordon 
Becker, Richard Cabot, Garlie Fore- 
hand, Harry Levitt, Robert Linn, H. 
William Morrison, Allen Newell, War- 
ren T. Norman, H. G. Osburn, Donald 
Rock, Robert Ruderman, Emir Shuford, 
Keith Smith, and John Vinshonlialer. 
Discussion leaders and symposium 
organizers were Harry Harman and 
Carl Helm. 

Model for ETS Shipping. 

LOUIS R. LAVINE 

A fascinating, relatively new pursuit 
within the educational community is 
the use of simulation models to cut 
costs and improve the efficiency of 
various operations. In essence, the 
total operation of some process is 
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analyzed from start to finish, and this 
operation is then translated into pro- 
grams for the computer. This pro- 
grammed, computerized "replica” of 
the actual real life operation is known 
as a simulation model. A sizable man- 
agement problem for ETS is scheduling 
the shipping of its tests throughout 

the United States and throughout 

much of the world. If optimal shipping 
strategics can be developed for ets 
testing programs, overshipment of lest 
materials can be avoided, and other 
important economies can be effected. 
This study designed and programmed 
a simulation model that will permit 

ETS program directors, analysts, and 

others to evaluate alternative strate- 
gies for shipping test materials. Strat- 
egies for shipping test materials that 
might be far too costly to compare in 
real life can be quickly and cheaply 
compared in the model. 

Scheduling Techniques . 

LOUIS R. LA VINE 

The scheduling of workloads in large 
organizations has gone beyond being a 
fine art practiced by adept managers. 
It is becoming a fine science practiced 
according to instructions from the 
computer. This study applied standard 
Program Evaluation and Review Tech- 
nique (pert) procedures to activities 
ranging from the Longitudinal Study of 
Disadvantaged Children to conversion 
from second-generation to third-gen- 
eration computers. As an independent 
effort, the study also developed a work- 



load scheduling program that utilized 
an algorithm for smoothing the overall 
workload for an individual (or an 
organization) by introducing peaks 
and valleys into the workload sched- 
ules for independent activities. The pur- 
pose of this effort was to develop tech- 
niques that may assist project directors 
and others in managing complex inter- 
nal projects. It should be of interest to 
ets project directors and division di- 
rectors, and to supervisory and staff 
personnel in the operational services 
departments. RM -69-14. 

Multivariate Change Pilot Study. 

ALBERT A. BEATON, THOMAS L. HILTON, 
CATIILEEN PATRICK 

Ever since the computer emerged oil 
the scene, the hope has persisted within 
educational research that useful 
theoretical models of very complex 
educational processes might be con- 
structed. Should the approach prove 
economically and technically feasible, 
one of many advantages would be that 
research results, which tend now to be 
lost in reports, would be accumulated. 
This study is exploring an approach of 
this type in making use of Growth 
Study data. Using measures and bio- 
graphical information relatingioscience 
achievement, a computer program for 
a method of longitudinal multivariate 
analysis has been developed and is 
■being tested on a number of theories of 
growth. Preliminary results indicate 
this may be an effective way of study- 
ing complex growth processes. The 
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research should be of interest to 
educational theorists and to research- 
ers concerned with the application of 
the computer to education. 

A List Processing Extension to PL-L 

WILLIAM A. LEAF 

A relatively new computer language 
known as pl-i is described by irm as an 
extremely sophisticated language com- 
bining algebraic power with the ability 
to deal with data in a wide variety of 
forms. Eventually, pl-i is intended to 
become the standard language for 
programmers whose applications cur- 
rently require many different lan- 
guages. However, pl-i has a weakness: 
its poor facility for dealing with al- 
phanumeric or numeric data stored in 
variable-length lists. The purpose of 
this project was to write routines that 
will give programmers easy methods of 
generating and manipulating such lists 
while retaining the full power of pl-i. 
Many of these routines have now been 
worked out. Their features include the 
dynamic allocation of space to handle 
increasing storage requirements of in- 
creasing-size lists, simple and informa- 
tive input/output of list structures, 
and convenient manipulation of data 
on the lists. Also available is a sub- 
routine called SNOSCAN, which dupli- 
cates the basic SNOBOL text processing 
facilities for pl-i character strings. A 
manual describing features and uses of 
pl-i/slip and SNOSCAN is being prepared. 
The research should be of interest to 
programmers and computer scientists, 
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Personality development and concepts of structure. Child 
Development , 1968, 39. 671-690, 

Models of continuity and change in development. Paper 
presented at the biennial meeting of the Society for Re- 
search in Child Development, symposium on Behavioral 
continuity and change with development, Santa Monica, 
California, March 27, 1969. 

Evans, Frank 

(With Stephen F. Klein) An examination of the validity of 
nine experimental tests for predicting success in law 
school. Educational and Psychological Measurements 
1968, 28, 909-913. 

(With Cathleeu Patrick) Antecedents and patterns of growth 
of school dropouts. Paper presented at the 76th annual 
meeting of the American Psychological Association. San 
Francisco, California, August 30, 1968. 

(With Stephen F. Klein & Donald A. Rock) The use of mul- 
tiple moderators in academic prediction. Journal oj Edu- 
cational M easurement, 1968, 5(2). 

Flauciier, Ronald L. 

A fixed length optimal test battery for colleges characterized 
by diverse aptitude levels. American Educational and Psy- 
chological Measurement, 1968, 5, 659-674. 

(With Richard S. Melton & Charles T. Myers) Item rear- 
rangement under typical test conditions. Educational and 



Psychological Measurement, 1968, 28,813-824. 

(With Donald A. Rock) A multiple moderator approach to 
the identification of over- and underachievers. Paper pre- 
sented at the National Council on Measurement in Educa- 
tion. February 1969. 

F RED ERIK SEN, N0R.\IAaV 

An experimental study of organizational climates and admin- 
istrative performance. Proceedings oj the XVIth Inter na- 
tional Congress oj Applied Psychology ; August 18-22, 

1968. Amsterdam : Swets & Zeitlinger, 1969. 

Administrative performance in relation to organizational 

climate. Paper presented at the annual meeting of the 
American Psychological Association Division 14 sympo- 
sium on Measuring managerial effectiveness, San Fran- 
cisco, California, September L 1968. 

(With Stephen F. Klein) Anxiety and learning to formulate 
hypotheses. Paper presented at the American Educational 
Research Association, I^os Angeles, California, February 
8, 1969. 

(With Bruce Bloxom) A three-mode component analysis of 
a person by situation by behavior data matrix. Paper pre- 
sented at the Psychometric Conference honoring Paul 
Horst, Seattle, Washington. June 22. 1969. 

Free berg, Norman E. 

(With Donald A. Rock) Factorial invariance of biographical 
factors. Multivariate Behavioral Research. April 1969, 4, 
195-210 (Paper also presented at the XVI International 
Congress of Applied Psychology, Amsterdam. August 
1968). 

Assessment of disadvantaged adolescents: A different ap' 
proach to research and evaluation measures. Research 
Bulletin 69-41. Princeto:, New Jersey: Educational Test- 
ing Service. May 1969. 

Development of evaluation measures for the use with neigh- 
borhood Youth Corps enrollees. Progress Report 68-5. 
Princeton, New Jersey: Educational Testing Service, 
December 1968. 

Freedle, Roy O. 

Implications of a short-term memory method for a k-span 
learning model: Some data on children. Research Bulletin 
69-4. Princeton, New Jersey: Educational Testing Service, 

1969. 

(With Mariya Craun) Observations with self-embedded sen- 
tences using written aids. Research Bulletin 69-22. Prince- 
ton, New Jersey : Educational Testing Service, 1969. 

(With Terrance Keeney & N. Smith) Effects of phrase struc- 
ture, mean depth, and grammatical ity on children’s imita- 
tion of sentences. Research Bulletin 69-79. Princeton, New 
Jersey : Educational Testing Service, 1969. 

(With Terrance Keeney & N. Smith) Children’s imitations 
of sentences evaluated by four response measures. Pro- 
ceedings oj the 77th annual convention oj the American 
Psychological Association, 1969, 47-48, 

(With Michael Lewis) On relating an infant’s observation 
time of visual stimuli with choice theory analysis. Re- 
search Memorandum 69-1. Princeton, New Jersey: Educa- 



tional Testing Service, 1969. 

(With A. Zavala & E. A. Fleishman) Studies of component- 
total task relations: Order of component-total task prac- 
tice and total task predictability. Human Factors , 1968, 
10, 283-296. 

A modified k-span learning model based on a new short-term 
memory method. Paper presented at the Mathematical 
Psychology meetings, Stanford University. August 28-29. 

1968. 

Asymmetric recognition matrices: A choice analysis as evi- 
dence for a hypothetical stimulus-sampling process. Paper 
presented at the spring meetings of the Psychometric Soci- 
ety, Educational Testing Service, Princeton, New Jersey, 
April 17-18, 1969. 

Fremer, John J. Jr. 

(With William E. Coffman) The College Board Scholastic 
Aptitude Test as a predictor of academic achievement in 
secondary schools in England. Journal of Educational 
Measurement, 1968, 5, 235-241. 

(With William E. Coffman) A look at the Scholastic Apti- 
tude Test — 1969. Speech presented at the workshop of 
Union County, New Jersey, Regional School District 
English teachers, February 1969. 

(With Ernest J. Anastasio and D. M. Marcotte) Computer 
assisted item writing — II (sentence completion items). 
Paper presented at the annual meeting of the National 
Council on Measurement in Education, Los Angeles, Cali- 
fornia. February 1969. Test Development Memorandum 
69-1. Princeton, New Jersey: Educational Testing Service, 

1969. 

(With Walter II. MacGinitie) The content of controlled con- 
tinuous word associations. In J. Rosenstein, and W. H. 
MacGinitie (Eds.) Verbal behavior of the deaf child: 
Studies of ivord meanings and associations . New York: 
Teachers College Press, 1969. 

(With Ernest J. Anastasio) Computer assisted item writing 
— I (spelling items). Journal of Educational Measure- 
ment, 1969, 6, 69-74. 

French, John W. 

Review of Raymond B. Cattell (Ed ). Handbook of Multi- 
variate Experimental l } sychology. Psychometrika, 1969, 
34,252-256. 

Goldman, Karla S. 

Attitudes & interests. Disadvantaged children and their first 
school experiences: Theoretical considerations and meas- 
urement strategies. Report in 2 volumes, December 1968, 
Contract OEO 4206, (Mice of Economic Opportunity. 
Progress Report 68-4. Princeton, New Jersey: Educa- 
tional Testing Service, 1968. 

Taxonomy of children’s interests. Disadvantaged children 
arid their first school experiences: Theoretical considera- 
tions and measurement strategies. Report in 2 volumes, 
December 1968, Contract OEO 4206, Office of Economic 
Opportunity. Progress Report 68-4. Princeton, New Jer- 
sey: Educational Testing Service, 1968. 



Gulliksen, Harold 

Louis Leon Thurstone, experimental and mathematical psy- 
chologist. American Psychologist , 1968, 23(11). 786-802. 

Methods for determining equivalence of measures. Psycho- 
logical Bulletin, 1968. 70(6). 534-544. 

Harold Gulliksen. a biography with bibliography. Revue de 
Psych ol ogle A ppliqu ee 9 4th trim. 1968. 18(4), 241-244. 

Developments in mental testing, and their relation to learn- 
ing. In W. Correll and Fritz Siillwold (Eds.). Forschung 
und Erziehung: Untersuclien der Problemen der Piida- 
gogik und l ) adagogischen l^sychologie. Gesamthcrstel- 
lung: Ludwig Auer, Donauworth, 1968. 

Hale, Gordon A. 

Reversal shift performance in children as a function of age, 
overtraining, and dimension preference. Unpublished 
doctoral dissertation, University of Minnesota, 1969. 

The effect of dimension “dominance” on the overtraining 
reversal effect in children. Paper presented at the meetings 
of the Society for Research in Child Development, Santa 
Monica, California, 1969. 

(With L. K. Miller, & H. W. Stevenson) Learning and prob- 
lem solving by retarded and normal subjects. American 
Journal of Mental Deficiency, 1968, 72, 681-690. 

(With G. M. Olson, L. K. Miller, & H. W. Stevenson) Long- 
term correlates of children’s learning and problem solving 
behavior. Journal of Educational I*sychology, 1968, 59, 
227-232. 

(With H. W. Stevenson, R. E. Klein, & L. K. Miller) Inter- 
relations and correlates in children’s learning and prob- 
lem solving. Monographs of the Society for Research in 
Child Development, 1968, 33, 7. 

(With II. W. Stevenson, R. E. Klein, & L. K. Miller) Solution 
of anagrams: A developmental study. Child Development, 
1968,39,905-912. 

Hall, Charles E. 

A procedure for testing the homogeneity of dispersion mat- 
rices. Paper presented at a meeting of the Psychometric 
Society, April 1969. 

Harman, Harry H. 

Factor analysis. Dean K. Whitla (Ed.), Handbook of meas- 
urement and assessment in behavioral sciences. Reading, 
Massachusetts: Addison-Wesley, 1968. 

(With Dean W. Seibel, Michael Rosenfeld, and Benjamin 
Shiinberg) Evaluation of driver education and training. 
Progress Report 69-1. Princeton, New Jersey : Educational 
Testing Service, 1969. 

Hartnett, Rodney T. 

Difference in selected attitudes and college orientations be- 
tween black students attending traditionally negro and 
traditionally white institutions. Research Bulletin 69-48. 
Princeton, New Jersey : Educational Testing Service, 1969. 

College and university trustees: Their backgrounds , roles, 
and educational attitudes, Princeton, New Jersey: Educa- 
tional Testing Service, 1969. 

(With Carol U. Libby) Agreement with views of Martin 



Luther King, Jr. before and after his assassination. Re- 
search Bulletin 68-35. Princeton. New Jersey: Educational 
Testing Service, 1968. (Eastern Psychological Associa- 
tion, Philadelphia, April 1969.) 

(With John A. Centra) Allit les and secondary school back- 
ground of Catholics entering college. Sociology of Educa- 
tion, 1969, 42(2). 

(With Richard Peterson) Religious preference as a factor 
in attitudinal and background differences among college 
freshmen. Sociology oj Education , 1968, 41 (2) . 

Hav'en, Elizabeth W. 

Curricular innovation and the subject-matter preparation of 
College Board test candidates. Speech presented at the 
American Educational Research Association, Los Angeles. 
California, February 5-8, 1969. 

Hermann. Margaret 

(With Henry A. Alker & Julia A. Carlson) Multiple-choice 
questions and student characteristics, Journal oj Educa- 
tional Psychology, 1969, 60, 231*243. 

(With J. A. Robinson & C. F. Hermann) Search under crisis 
in political gaming and simulation. In D. G. Pruitt & R. C. 
Snyder (Eds.), Theory and research on the causes oj i car. 
Englewood Cliffs, New Jersey: Prentice-Hall, 1969. 

(With Nathan Kogan) Effects of representative status and 
decision style on cooperation in the prisoner’s dilemma. 
Paper presented at the meeting of the Eastern Psychologi- 
cal Association, Philadelphia, Pennsylvania, April 1969. 

Hilton, Thomas L. 

Ten basic questions in guidance and school learning. Corn • 
puter-based Vocational Guidance Systems. Washington, 
D.C.: U. S. Government Printing Office, 1969. 

(With Cathlecn Patrick) Cross-sectional versus longitudinal 
data : An empirical comparison of mean differences in aca- 
demic growth. Research Bulletin 69-28. Princeton, New 
Jersey: Educational Testing Service, 1969. 

(With Michael Rosenfcld) Negro-white differences in ado- 
lescent educational growth. Research Bulletin 69-71. 
Princeton, New Jersey: Educational Testing Service, 1969. 

Holman, Eric W. 

General constraints on sequential properties of learning. 
Paper presented at the Mathematical Psychology meeting. 
Stanford, California, August 1968. 

Ironside, Roderick A. 

Demonstration reading classes. An ETS critical appraisal for 
the ESEA staff, Chicago Public Schools, July 1968. 

A test of literary appreciation for middle graders. Speech 
presented at the annual convention of the National Coun- 
cil of Teachers of English, November 1968. 

Measuring adult basic education skills: Emphasis on valid- 
ity. Speech presented at the tenth national seminar on 
Adult Education Research, Toronto, Canada, February 
1969. 

Who assesses reading progress: Tests, teachers, or students? 
Speech presented at the annual convention of the College 



Reading Association, Boston, Massachusetts. March 1969. 

Techniques in the diagnosis of reading difficulties. Speech 
presented at the annual meetings of the North Carolina 
Council, International Reading Association, April 1969. 

Law enforcement survey. Project report to the WGBH Edu- 
cational Foundation, Boston, Massachusetts, July 1968. 

Jacobs, Paul I. 

(Willi Mary Vandeventer) Progressive matrices: An experi- 
mental developmental, nonfactorial analysis. Perceptual 
and Motor Skills, 1968, 27, 759-766. 

(With Mary Vandeventer) The learning and transfer of 
double-classification skills by first-graders. Research Bul- 
letin 68-65. Princeton. New Jersey: Educational Testing 
Service, 1968. 

(With Mary Vandeventer) Evaluating the teaching of intel- 
ligence. Research Bulletin 69-20. Princeton. New Jersey: 
Educational Testing Service. 1969. 

(With Mary Vandeventer) The learning and transfer of 
double-classification skills: A replication and extension. 
Research Bulletin 69-88, Princeton. New Jersey: Educa- 
tional Testing Service, 1969. 

(With Mary Vandeventer) Information in wrong responses. 
Psychological Reports, 1970, 26. 311-315. 

Jensen, Ollie A. 

Constructing objective lest items. In J. J. Donovan (Ed.). 
Recruitment and selection in the Public Service. Chicago, 
Illinois: Public Personnel Association, 1968. 

(With Norman Frederiksen and Albert E. Beaton) Organi- 
zational climates and administrative performance. Re- 
search Bulletin 68-41. Princeton, New Jersey: Educational 
Testing Service, 1968. 

Joreskog, Karl G. 

Statistical models for congeneric test scores. Proceedings of 
the American Psychological Association . 76th Annual 
Convention, 1968, 213-214. 

(With D. N. Lawlcy) New methods in maximum likelihood 
factor analysis. British Journal oj Mathematical and Sta- 
tistical Psychology, 1968, 21, 85-96. 

(With P. B. Warr and R. E. Lee) A note on the factorial na- 
ture of the F and D scales. British Journal oj Psychology , 
1969, 60, 119-123. 

A general approach to confirmatory maximum likelihood 
factor analysis. Psychomeirika , 1969, 34, 183-202. 

Efficient estimation in image factor analysis. Psychomeirika , 
1969,34,51-75. 

Katz, Martin R. 

Learning to make wise decisions. In Alice Scates (Ed.), 
Computer-based Vocational Guidance Systems. Washing- 
ton, D.C.: U.S. Department of Health, Education, and 
Welfare, Office of Education, 1969. 

Counseling — Secondary school. In R. Ebel (Ed.), Encyclo- 
pedia of Educational Research. (4th ed.) New York: 
MacMillan, 1969. 

Theoretical foundations of guidance. Review of Educational 
Research, April 1969, 39, 127-140. 
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Are aptitude tests unfair to Negroes? In E.F. Borgetta (Ed.) , 
Social Psychology : Readings and Perspective. Chicago: 
Rand -McNally, 1969. 

Measuring interests. Tape recording produced for Sound 
Seminars. McGrnw Hill. 1969. 

Selecting an achievement test: Principles and procedures. 
Reprinted in N. Gronlund (Ed.), Readings in 1 Measure- 
ment and Evaluation. New York : MacMillan, 1968. 

Tu : Oggi e Domani. Firenze: Adattamento Italiano a Cura 
di Franca Magnani, 1968. 

Guida per IJInsegnantc. Firenze: Adattamento Italiano a 
Cura di Franca Magnani, 1969. 

Rationale for a computer-assisted system of interactive guid- 
ance and information. Paper presented at the annual 
meeting of the College Entrance Examination Board, New 
York, New York, October 29, 1968. 

Keeney, Terrence J. 

(With J. R. Jenkins & J. J. Jenkins) Identification of abso- 
lute and relational properties in the three-stimulus (ABB) 
configuration. Child Development , 1969, 40, 1223-1231. 

Permutation transformations on phrase structures in letter 
sequences. Journal of Experimental Psychology , 1969, 82, 
28-33. 

Young children’s imitation of nonsense syllable strings, word 
strings, and grammatical sentences. Paper presented at the 
meeting of the Society for Research in Child Development, 
Santa Monica, California, March 28, 1969. 

The operation of permutation rules on hierarchical and non- 
hierarchial structures. Paper presented at the meeting of 
the Mid-Western Psychological Association, Chicago, 
Illinois, May 1969. 

Kogan, Nathan 

(With E. Pankove) Creativity and risk taking in elementary 
school children. Journal of Personality , 1968, 36, 420-439. 

(With Julia Carlson) Difficulty of problems attempted under 
conditions of competition and group consensus. Journal 
of Educational Psychology , 1969, 60, 158-167. 

(With W. Doise) Effects of anticipated delegate status on 
level of risk taking in small decision-making groups. Acta 
Psychologica, 1969, 29, 228-243. 

(With Henry A. Alker) Effects of norm-oriented group dis- 
cussion on individual verbal risk taking and conservatism. 
Human Relations , 1968, 21, 393-405. 

(With Margaret G. Hermann) Effects of representative status 
and decision style on cooperation in the prisoner’s dilem- 
ma. Paper presented at the meeting of the Eastern Psycho- 
logical Association, Philadelphia, Pennsylvania, April 
1969. 

(With Margaret G. Hermann) Negotiation in leader and 
delegate groups. Journal of Conflict Resolution , 1968, 12, 
332-344. 

(With F. T. Morgan) Task and motivational influences on 
the assessment of creative and intellective ability in chil- 
dren. Paper presented at the biennial meeting of the Soci- 
ety for Research in Child Development, Sr.- h*. 'Tunica, 
California, March 1969. 
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Kristof. Walter 

(With Michael Browne) On the oblique rotation of a factor 
matrix to a specified pattern. Psychometrika. 1969. 34, 
237-248. 

Estimation of true score and error variance for tests under 
various equivalence assumptions. Paper presented at the 
Mathematical Psychology meeting, Stanford, California. 
August 1968. 

(Jnlersuchungen zur Theorie psychologischen Messcns. Mei- 
senheim (Germany) : Hain, 1969. 

A general theory of oblique factor rotation. Paper presented 
at the meeting of the Psychometric Society, Princeton, 
New Jersey, 1969. 

Structural properties and measurement theory of certain sets 
admitting a concatenation operation. British Journal of 
Mathematical and Statistical Psychology , 1968, 21, 201- 
229. 

Lanniiolm, Gerald V. 

(With Gary L. Marco & William B. Schrader) Cooperative 
Studies of Predicting Graduate School Success. Graduate 
Record Examinations Special Report 68-3, August 1968. 

The Use of CRE Scores and Other Factors in Graduate 
School Admissions. Graduate Record Examinations Spe- 
cial Report 68-4, October 1968. 

Leaf, William A. 

(With D. E. Kanouse, J. A. Jones, & R. P. Abelson) Balance, 
character expression, and the justice principle: An analy- 
sis of sentence evaluations. Paper presented at the 76th 
annual convention of the American Psychological Associ- 
ation, San Francisco, California, 1968. 

Lewis, Michael 

(With Marilyn Rausch, Susan Goldberg, & Cornelia Dodd) 
Error, response time and IQ: Sex differences in cognitive 
style of preschool children. Perceptual and Motor Skills , 
1968, 26, 563-568. 

(With L. W. Sontag & W. G. Steele) The fetal and maternal 
cardiac response to environmental stress. Human Develop- 
ment, 1969, 12(1) ,1-9. 

(With Susan Goldberg) The acquisition and violation of ex- 
pectancy: An experimental paradigm. Journal of Experi- 
mental Psychology , 1969, 7, 70-80. 

(With Susan Goldberg) Perceptual-cognitive development in 
infancy: A generalized expectancy model as a function of 
the mother-infant interaction. M err ill-P aimer Quarterly of 
Behavior and Development, 1969, 15(1). 81-100. 

Infants’ responses to facial stimuli during the first year of 
life. Developmental Psychology , 1969, 1, 75-86. 

(With Susan Goldberg) Play behavior in the year-old infant: 
Early sex differences. Child Development , 1969, 40, 21-31. 

(With Cornelia Dodd) The cardiac response to a perceptual 
cognitive task in the young child. Paper presented at the 
eighth annual meeting of the society for Psychophysiologi- 
cal Research, Washington, D.C., October 1968. 

The meaning of an OR: A study in the hierarchical order of 
attending. Paper presented at the meetings of the Society 
for Research in Child Development, symposium on The 
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orienting response: Issues in developmental inquiry. 
Santa Monica. California. March 1969; and at the XfXth 
Internationa] Congress of Psychology. London. England, 
July 1969. 

(With Cornelia Dodd) Attention distribution as a function 
of complexity and incongruity in the 24-month-old child 
Paper presented at the meeting of the Eastern Psycho- 
logical Association, Philadelphia, Pennsylvania. April 
1969; and at the Fourth International Seminar on Special 
Education. Cork, Ireland. September 1969. 

Ljnn, Robert L. 

Computer-assisted testing. Speech presented at the sympo- 
sium on The computer utility — Implications for higher 
education, Manchester, New Hampshire, May 5-7, 1969. 

(With T. Anne Cleary & Donald A. Rock) Reproduction of 
total test score through the use of sequential programmed 
tests. Journal of Educational Mcasu rem ent, 1968, 5, 183* 
187. 

(With T. Anne Cleary) A note on the relative sizes of the 
standard errors of two reliability estimates. Journal of Ed - 
ucational Measurement, 1969, 6, 25-28. 

(WitliT. Anne Cleary) Error of measurement and the power 
of a statistical test. British Journal oj Mathematical and 
Statistical Psychology. 1969, 22, 49-55. 

A note on the stability of the Iowa tests of basic skills. Jour- 
nal of Educational Measurement, 1969, 6, 29-30. 

(With Donald A. Rock & T. Anne Cleary) The development 
and evaluation of several programmed testing methods. 
Educational and Psychological Measurement , 1969, 29, 
129-146. 

(With Charles E. Werts) Analyzing school effects: How to 
use the same data to support different hypotheses. Ameri - 
can Educational Research Journal, 1969, 6, 439-447. 

Lord, Frederic M. 

Some test theory for tailored testing. Speech presented to the 
Conference on computer-based learning, instruction, test- 
ing, and guidance, Austin, Texas, October 1968. 

Estimating true-score distributions in psychological testing 
(An empirical Bayes estimation problem). Paper pre- 
sented at the meeting of the American Association for the 
Advancement of Science, Dallas, Texas, December 1968. 

An analysis of the Verbal Scholastic Aptitude Test using 
BirnbaunFs three-parameter logistic model. Educational 
and Psychological Measurement, 1968, 28, 989-1020. 

Marco, Gary L. 

The performance of first-year graduate students on the Grad- 
uate Record Examinations. GRE Special Report 68-2, 
July 1968. 

(With Gerald V. Lannholm& William B. Schrader) Coopera- 
tive studies of predicting graduate school success. GRE 
Special Report 68-3, August 1968. 

A design for evaluating educational programs in a large city. 
In J. L. Hayman, Jr. (Chm.), Management problems in 
conducting large-scale research and evaluation studies. 
Symposium presented at the annual meeting of the Ameri- 
can Educational Research Association, Los Angeles, 



California, February 1969. 

(With Stanley Zdep) A commentary on Kcrlingcr's struc- 
tural theory of social altitudes. Research Bulletin 69-49. 
Princeton. New Jersey: Educational Testing Service, June 
1969. 

Medley, Donald M. 

(With Carolyn Schluck & Nancy Ames) Assessing the learn- 
ing environment in the classroom: A manual for PROSE 
recorders. Princeton, New Jersey: Educational Testing 
Service, December 1968. 

(With R. A. Hill) Goal oriented teaching exercise: Method- 
ology for measuring the effects of teaching strategics. 
Paper presented at the annual meeting of the American 
Educational Research Association, Los Angeles. Califor- 
nia, February 1969. 

OScAR goes to nursery school: A new technique for observ- 
ing pupil behavior. Research Memorandum 69-15, Prince- 
ton. New Jersey: Educational Testing Service. 1969. 
(Paper presented at the annual meeting of the American 
Educational Research Association, J_,os Angeles, Cali- 
fornia, February 1969). 

The impact of the classroom. In Disadvantaged Children and 
Their First School Experiences, Theoretical Considera- 
tions and Measurement Strategies. Project Report 68-4. 
Princeton. New Jersey: Educational Testing Service. 
December 1968. 

(With R. A. Hill) Dimensions of classroom behavior meas- 
ured by two systems of interaction analysis. Educational 
Leadership , 1969, 26. 821-824. 

The research context and the goals of teacher education. 
Educational Co mm Toledo, Ohio : University of Toledo. 

1969. 

Messick, Samuel 

Response sets. In D. T^. Sills (Ed.), International Encyclo- 
pedia oj the Social Sciences. Crowell-Collier, 1968. 

(With L. J. Strieker & D. N. Jackson) Desirability judgments 
and self-reports as predictors of social behavior. Journal 
of Experimental Research in Personality, 1969. 3, 151-167. 

Measures of cognitive styles and personality and their poten- 
tial for educational practice. In K. Tngenkamp & T. 
Marsolek (Eds.). Developments in Educational Testing. 
London: University of London Press, 1968. (Also pub- 
lished in German : In K. Ingenkamp & T. Marsolek (Eds.; , 
Moglichkeiten und Grenzen der T estamvendahg in der 
Schule. Berlin: Julius Beltz, 1968.) 

(With D. N. Jackson) A distinction between judgments of 
frequency and of desirability as determinants of response. 
Educational and Psychological Measurement , 1969, 29, 
273-292. 

(With L. J. Strieker & D. N. Jackson) Dimensionality of 
social influence. Proceedings of the 76th Annual Conven- 
tion of the American Psychological Association, 1968, 
189-190. 

(With L. J. Strieker & D. N. Jackson) Evaluating deception 
in psychological research. Psychological Bulletin , 1969, 
71, 343-351. 

Can you do real research in the real world? Untangling the 
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Tangled Web oj Education. Research Memorandum 69-6. 
Princeton, New Jersey; Educational Testing Service, 1969. 

(With M. Dunnette (Ed.), B. Baxter, D. W. Bray. A. Carp. 
R. L. Ebel. and A. G. Wesman) Job testing and the disad- 
vantaged. American Psychologist , 1969, 21,637-650. 

Norton, Daniel P. 

The potency of educational treatments. Speech presented to 
a pre-session of the Wisconsin Education Research As- 
sociation, December 1967. 

Management emphases in the installation of an evaluation 
stafT for federally-funded projects in a large city. Paper 
presented at the symposium on Management problems in 
conducting large-scale research and evaluation studies at 
the AERA meeting, February 1969. 

Curricular supplements for educational researchers. Speech 
presented at the American Association of Professors of 
Educational Research, Summer 1968. 

(With Jayjia Hsia) Evaluation of integration of Evanston 
District 65 schools — Interim Report, June 1969. 

Novick, Melvin R. 

(With FreJaric M. Lord and Allen Birnbauin) Statistical 
Theories oj Mental Test Scores. Reading, Massachusetts: 
Addison-Wesley, 1968. 

Review of J. E. Hill and A. Kerbcr, Models, methods, and 
analytical procedures in educational research. Journal of 
the Royal Statistical Society, Series A, 1968, 131,440-441. 

(With M. A. Woodbury) Maximizing the validity of a test 
battery as a function of test length for a fixed total testing 
time. Journal oj Mathematical Psychology , 1968, 5, 242- 
259. 

Multiparameter Bayesian indifference procedures (with 
discussion). Journal of the Royal Statistical Society , 
Series B, 1969,31, 29-64, 

(With D. T. Thayer) Some applications of procedures for 
optimally allocating testing time. Research Bulletin 69-1. 
Princeton, New Jersey : Educational Testing Service, 1969. 

(With D. T. Thayer) A general computer program for op- 
timally allocating testing time. Research Bulletin 69-50. 
Princeton, New Jersey : Educational Testing Service, 1969. 

A Bayesian approach to the selection of predictor variables. 
Research Bulletin 69-58. Princeton, New Jersey: Educa- 
tional Testing Service, 1969. 

(With D. T. Thayer) A study of corrections for restriction 
of range. Research Memorandum 69-22. Princeton, New 
Jersey: Educational Testing Service, 1969. 

Owen, Roger J. 

A Bayesian analysis of Raseh’s multiplicative model for 
misreadings. Research Bulletin 69-64. Princeton, New 
Jersey: Educational Testing Service, 1969. 

A Bayesian approach to tailored testing. Research Bulletin 
69-92. Princeton, New Jersey: Educational Testing Serv- 
ice, 1969. 

Payne, Donald T. 

(With Mary Ellen Parry & Stephen Ilarasymiw) Percentage 
of pupillary dilation as a measure of item difficulty. Per- 



ception & Psychophysics , 1 968, 4 (3), 139*143. 

Pennell, Roger 

The influence of communality and N on the sampling distri- 
butions of factor loadings. Psych onu'lrika , December 

1968, 33, 423-440. 

Iterated communal ities. convergence, and the number of 
common factors. Educational and Psychological Measure- 
merit , Autumn 1968, 28, 793*802. 

True variance in the common factor solution. Proceedings of 
the 76th Annual Con cent ion of the American Psycholog- 
ical Association , 1969. 

A new method for estimating common factor scores. Paper 
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